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ABSTRACT 


Th«  problem  of  the  rigorous  simultaneous  odjustment  of  large  photo- 
grommetric  blocks  is  reviewed  and  extensions  to  an  earlier  theory  are  developed. 
Vorious  matrix  iterative  approaches  to  the  solution  of  the  very  large  systems  of 
normal  equations  characteristic  of  sizeable  photogrammetric  nets  are  investigated. 
The  Method  of  Block  Successive  Over  Relaxotion  is  found  to  yield  c  practical 
arKl  most  satisfactory  solution  to  this  problem.  Results  of  on  extensive  series  of 
numerical  simulations  are  reported.  The  successful  application  of  the  approach 
to  a  23-photo  strip  of  actual  photography  provides  final  confirmation  of  the 
validity  and  effectiveness  of  the  solution. 
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PREFACE 


Th«  abjective  of  this  study  is  to  develop  a  computationally  feasible  procedure 
for  the  solution  of  very  large  systems  of  normal  equations  generated  in  the  process  of 
simultaneous  adjustment  of  oil  observations  arising  from  a  large  photogrammetric  net. 
Although  the.  theory  for  forming  the  normal  equations  in  a  systematic  and  practical 
manner  was  developed  over  six  years  ago  by  one  of  the  writers  (Brown,  1958  a),  it  has 
widely  been  held  that  the  sheer  size  of  the  norma!  equatioris  for  long  strips  or  iorge 
blocks  of  photography  would  restrict  the  application  of  the  theory  in  its  full  generality 
to  photogrammetric  nets  of  relatively  modest  dimensions.  Consequently,  efforts  at 
applying  the  theory  have  concentrated  largely  on  piecewise  adjustments  according  to 
various  schemes  ranging  from  cantilever  extension  using  three  or  more  photos  per  step 
to  extension  through  adjustment  of  small  blocks.  All  such  solutions  ore,  of  course, 
compromises  dictated  solely  by  computational  considerations.  Few  will  argue  the 
desirability  of  simultaneous  adjustment  of  sizeable  photogrammetric  nets,  but  many  will 
argue  its  practicability.  We  therefore  take  considerable  pride  in  announcing  our 
success  in  developing  an  altogether  practical,  yet  uncompromisingly  rigorous  solution 
to  the  problem  of  adjusting  large  photogrammetric  nets.  Surprisingly,  there  is  evidence 
thot  the  efficiency  of  the  solution  increases  with  increasing  dimensions  of  the  photo¬ 
grammetric  net  and  is  even  greeter  with  blocks  than  with  strips.  The  solution  of  the 
normal  equations  is  accomplished  through  the  application  of  techniques  of  matrix  iterative 
analysis  developed  over  the  past  decade  by  investigators  Concerned  primarily  with  the 
solution  of  large  systems  of  linear  equations  arising  from  the  numerical  solution  of  systems 
partial  differential  equations.  A  comprehensive  treatment  of  matrix  Iterative  techniques 
Is  provided  by  a  recently  published  book  (Varga,  1962). 

Our  study  has  been  divided  into  two  major  parts.  Section  1  provides  the  overall 
theoretical  development  essential  to  the  solution.  It  also  incorporates  a  number  of  re¬ 
finements  (some  previously  published,  others  not)  of  the  original  photogrammetric  theory 


(Brown,  1958  a).  In  particular,  it  fully  develops  the  concept  of  the  'ellipsoidal 
control  point'  (previously  introduced  in  Brown,  1959,  as  a  special  cose  of  the  awkwardly 
phrased  concept  of  'relaxation  of  quasi-observatianal  variances').  The  general  adjust¬ 
ment  is  extended  to  accommodate  observations  provided  by  auxiliary  external  sensors 
(Inertial  systems,  aircraft  tracking  systems,  etc.).  Provisions  are  made  for  the  cali¬ 
bration  of  such  sensors  as  an  Integral  part  of  the  overall  adjustment. 

Section  2  outlines  the  numerical  procedures  employed  In  implementing  the 
solution  ond  presents  detailed  results  of  on  extensive  program  of  numerical  simulation 
designed  to  evaluate  the  effectiveness  of  the  general  approach  developed  in  Section  1. 
Several  specific  approaches  within  the  framework  of  the  general  approach  are  investigated 
to  determine  the  porticular  variant  leading  to  the  most  effective  results. 
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SECTION  1 


THEORETICAL  DEVELOPMENT 


By 


Duane  Brown 


1.01  INTRODUCTION 

In  a  previous  paper  (  Brown,  1958  o),  the  writer  presented  o  rigorous  least 
squares  solution  effecting  the  simultaneous  adjustment'  of  the  entire  set  of  original 
plate  measurement  arising  from  a  completely  general  photogrammetric  net.  It  wo; 
shown  that  the  development  of  the  general  normal  equations  was  an  entirely  straight¬ 
forward  procedure  presenting  r>o  difficulties  even  with  a  digital  computer  of  relatively 
small  capacity.  A  direct  solution,  however,  was  considered  to  be  impractical  for  large 
photogrammetric  nets  because  of  the  prohibitive  dimensions  of  the  normal  equations.  A 
practical  means  was  developed  to  collapse  the  system  of  general  normal  equations  to  a 
more  tractible  system  of  reduced  rwrmal  equations  whose  dimensions  were  independent 
of  the  number  of  unknown  relative  control  points  and  were  dependent  only  on  the  total 
number  of  unknown  elements  of  orientation.  This  version  of  the  solution  found  immedi¬ 
ate  application  in  space  geodesy  (Brown,  1958  b,  1959,  1960  a)  wherein  powerful  stellar 
control  could  be  exploited  to  reduce  the  number  of  unknown  elements  of  orientation  to 
three  per  exposure  station  ( the  X,  Y,  Z  of  each  station).  Even  rather  large  geodetic 
nets  (up  to  100  stations)  were  considered  to  be  amenable  to  this  approach  for  in  practice 
only  a  handful  of  stations  in  the  over-all  network  would  observe  a  given  group  of  flashes 
thereby  making  possible  the  piecewise  formation  of  the  partial  normal  equations  generated 
by  relatively  small  local  configurations;  the  formation  of  the  final  system  of  normal  equa¬ 
tions  would  thus  reduce  to  a  simple  matter  of  appropriate  dissection  and  subsequent  summing 
of  the  partial  normal  equations  of  individual  configurations.  In  such  geodetic  applications, 
the  solution  of  large  systems  of  equations  would  normally  have  to  be  faced  only  at  Infre¬ 
quent  intervals  and  hence  would  warrant  an  effort  which  would  otherwise  be  considered 
prohibitive. 
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In  Brown  (1958  b)  the  writer  outlined  on  extension  of  the  general  adjustment 
to  account  for  errors  in  presurveyed  locations  of  exposure  stations,  This  extension  was 
further  developed  in  the  Appendix  tc  c  later  report  (Brown,  1959).  Here,  the  solution 
was  modified  to  cover  the  case  in  which  any  of  the  elements  of  orientation  and  any  of 
the  coordinates  of  control  are  considered  to  be  measured  quontities  subject  to  odjust- 
ment.  In  the  originol  solution,  these  quantities  were  considered  to  be  either  perfectly 
krrown  or  to  be  wholly  unknown  and  the  entire  odjustment  wos  placed  on  the  measured 
plate  coordinates. 

In  an  unpublished,  privately  circuloted  poper  (  Brown,  1960b)  which  is  referred 
to  by  Case  (  1961),  the  writer  further  extended  the  basic  solution  to  incorporate  orbital 
constraints  applicable  to  a  satellite-borne  camera.  Here  it  was  shown  that  the  entire 
vector  of  coordinates  of  exposure  stations  for  a  given  orbital  pass  could  be  reploced  by 
a  6  X  1  vector  of  osculoting  Keplerian  elements,  these  in  turn  being  determined  as  part 
of  the  over-all  photogrammetric  reduction. 

The  first  unclassified  application  of  the  exten-'td  form  of  the  writer's  solution  to 
aerotriangulatlon  is  probably  that  of  Dowdy  and  McClure  (  1962),  Here,  a  computer  pro- 
grom  for  the  simultaneous  odjustmen.  of  as  many  as  12  photogrophs  was  developed  for  the 
IBM  709  Computer.  For  long  photogrammetric  strips,  the  program  employed  what  might 
be  called  a  long  base  cantilever  in  which  six,  seven,  or  eight  successive  photos  were 
corried  in  each  odjustment.  Dowdy  ond  McClure  applied  the  progrom  to  the  adjustment 
of  1 1  sub-blocks  of  a  50  photo  block  of  actual  photography,  The  solution  ol lowed  not 
only  for  adjustment  of  plate  coordinates,  but  olso  for  adjustment  of  ground  control.  Al¬ 
though  the  standard  deviations  assigned  to  the  ground  control  ronged  typically  from  20 
to  30  ft.,  the  published  adjustment  of  the  ground  control  turned  out  to  be  smoll  froctions 
of  a  foot.  Dowdy  and  McClure  expressed  concern  over  such  unrealistically  smoll  corrections 
but  were  unoble  to  offer  a  specific  explanation  for  the  result.  The  present  writer,  in  seeking 
on  explanation  for  this  untoward  result,  carefully  studied  the  flow  charts  ond  program  listings 
published  by  Dowdy  and  McClure.  Both  were  found  to  be  In  good  order  and  disployed  a 
sound  understanding  of  the  method.  The  difficulty  was  finally  traced  to  on  easily  mode 
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blunder  in  weighting  wherein  two  different  unit  variances  were  implicitly  carried  In 
the  same  adjustment;  the  one  for  the  ground  control  and  the  other  for  the  plate  measure¬ 
ments.  More  specifically,  the  weights  ossigned  to  the  ground  control  points  were  taken 
as  the  straight  reciprocals  of  their  variances  thereby  automatically  fixing  unit  variance 
at  unity.  Accordingly,  the  weights  of  the  plate  coordinates  should  also  have  been  taken 
as  the  straight  reciprocals  of  their  voriartces.  Actually,  they  were  rtot,  for  all  plate 
coordinates  were  assigned  unit  weight.  If  onewereto  regard  the  standard  deviation  of 

the  typical  plate  coordinate  os  being  0  =  0.025  mm,  the  weight  of  the  plate  coordinate 

2 

would  then  properly  become  1/(.025)  =  1600,  rather  than  unity.  Accordingly,  in  Dowdy 
and  McClure's  study,  all  of  the  plate  coordir>ates  were  grossly  underweighted  (  by  a  factor 
on  the  order  of  1000  to  2000)  or,  equivalently,  all  of  the  ground  coordinates  were  grossly 
overweighted  (  again,  by  a  factor  on  the  order  of  1000  to  2000).  Hence,  essentially  all 
of  the  adjustment  was  placed  on  the  plate  coordinates  and  practically  none  was  placed  on 
the  ground  coordinates.  For  all  practical  purposes,  then,  the  ground  control  was  actually 
treated  as  if  it  were  perfectly  krvjwn.  Within  this  context.  Dowdy  and  McClure's  numerical 
results  may  be  viewed  as  beirsg  valid. 

Dowdy  and  McClure  indicate  the  IBM  709  runnirsg  time  of  the  program  for  a  twelve 
photo  adjustment  to  be  slightly  more  than  one  half  hour  per  iteration.  Inasmuch  as  compu¬ 
tations  required  for  the  formation  and  for  the  solution  of  the  reduced  normal  equations  in¬ 
crease  as  the  square  and  cube,  respectively,  of  the  number  of  photos,  it  follows  that  be¬ 
tween  two  and  four  hours  would  be  required  per  iteration  for  a  twenty  four  photo  adjust¬ 
ment  and  that  between  eight  and  thirty  two  hours  would  be  required  per  iteration  for  a 
forty  eight  photo  adjustment  (  this  assumes  that  sufficient  memory  were  available  to  keep 
all  computations  in  core).  Normally  two  to  three  iterative  cycles  would  be  required  for 
adequate  convergence,  thus  doubling  to  tripling  the  above  figures.  Small  wonder,  then, 
that  in  recent  years  enthusiasm  has  generally  waned  for  the  idea  of  rigorous  and  simultan¬ 
eous  adjustment  of  large  blocks  of  photos.  Instead,  efforts  have  been  directed  mostiv 
toward  development  of  compromise  solutions  such  as  extension  by  anolytical  pairs,  triplets 
or  sub-blocks  with  subsequent  adjustment  of  the  model  to  absolute  control  (  e.g. ,  Mikhail, 
1962,  1963;  El-Assal,  1963;  Schut,  1964;  Harris,  Tewinkel,  Whitten,  1962)  or  adjustment 


of  strips  or  blocks  of  modest  dimerisions,  typical  1/  of  25  photos  or  less  (  e.g. ,  Dowdy 
and  McClure,  op.  cit.;  Matos,  1963).  A  broad  review  of  the  development  of  analyt¬ 
ical  techniques  is  given  by  Doyle  (1964). 

From  the  foregoing,  it  appears  that  the  general  impetus  towards  the  Implementa¬ 
tion  of  the  uncompromisingly  rigorous  adjustment  of  large  photogrammetric  blocks  has  In 
great  measure  died  out  In  favor  of  suboptimol  but  more  easily  Implemented  analytical 
approaches.  Nonetheless,  the  desirability  of  simultaneous  adjustment  is  conceded  by 
virtually  all  investigators.  Because  of  the  general  abandorvnent  of  the  ideal  of  simul¬ 
taneous  adjustment,  o  Pandora's  box  of  alternative  approaches  (most  being  minor  variations 
of  one  another  )  seems  to  have  been  opened  leading^ In  the  writer's  view,  to  the  generally 
chaotic  present  state  of  analytical  photogrammetry. 

As  hos  already  been  Indicated,  the  stumbling  block  to  the  Implementation  of 
rigorous  block  adjustment  has  been  the  solution  of  the  very  large  systems  of  normal  equa¬ 
tions  generoted  by  blocks  of  even  fairly  modest  dimension.  As  we  indicated,  the  formation 
of  the  normal  equotions  themselves  is  a  relatively  minor  problem.  In  all  approaches 
reported  to  date  the  solution  of  the  normal  equations  has  been  effected  by  one  or  another 
of  the  numerous  variants  of  Gaussian  elimination.  This  has  set  a  practical  limit  (on  the 
order  of  25  photos)  to  the  size  of  the  photogrammetric  net  which  can  be  handled,  for 
computational  difficulties  with  Gaussian  elimination  increase  severely  with  increosing 
numbers  of  unknowns. 

In  1958,  the  writer  experimented  briefly  with  the  Gauss-Seldel  iterative  technique 
for  the  solution  of  linear  equations  only  to  abandon  It  as  utterly  impractical  upon  finding 
its  rate  of  convergence  to  be  Insufferably  slow.  However,  in  1962,  the  writer's  Interest 
In  the  possibilities  of  the  Gauss-Seide!  approach  was  rekindled  upon  reading  in  Faadeva 
(1959)of  an  accelerating  process  developed  by  Luisternik  (  194^.  It  was  further  aroused 
upon  the  writer's  discovery  that,by  means  of  a  scheme  of  ordering  the  unknowns  of  the 
general  normol  equations  generated  by  a  'uniform  block'  (to  be  defined  later),  it  was 
possible  to  obtain  a  coefficient  matrix  having  highly  diagonal  characteristics.  Indeed, 
the  writer  found  that  with  a  'uniform  block'  it  was  possible  to  develop  an  ordering  which 
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would  confine  oil  nonzero  elemenfs  of  the  coefficient  matrix  to  o  comparatively 
narrow  bond  obout  the  principal  diagonal,  the  width  of  the  band  being  completely 
independent  of  the  photodlmentlont  of  the  block.  Such  strong  diagonality,  it  teemed 
to  the  writer,  might  well  enhance  the  prospects  of  acceptably  rapid  convergence  of  an 
iterative  proceu  of  solution.  In  further  conjectural  development  of  the  renewed  potsi- 
blllties  of  an  Iterative  approach,  the  writer  conceived  of  a  proceu  for  the  systemotic 
formation  the  normal  equations  in  which  on  algorithmic  scheme  of  indexing  could  be 
employed  to  bypau  the  computation  of  all  zero  elements  of  the  rKxmal  equations,  thereby 
lending  to  the  direct  formation  of  an  equivalent  '  collapsed'  system  of  far  smaller  dimen> 
sions.  This  concept  of  'collapsed  normal  equations'  further  enlarged  the  ponibility  of 
the  ultimate  development  of  a  practical  approoch  to  the  problem  of  the  rigorous  odjust* 
ment  of  large  photogrommetric  nets.  In  December  1962,  these  Ideas  were  expressed  for* 
mally  in  a  technical  proposal  to  Rome  Air  Development  Center,  resulting  subsequently  In 
the  award  of  the  present  contract  to  investigate  their  practicability. 

As  we  shall  see,  the  applicability  of  the  accelerated  Gauu-Seidel  process  turned 
out  to  be  decidedly  marginal.  On  the  other  bond,  the  application  of  a  more  powerful 
iterative  technique  (that  of  succeulve  overrelaxation)  proved  to  be  successful  beyond 
all  expectation.  As  a  result,  the  rigorous  odjustment  of  blocks  of  large  dimensions  may 
now  be  sold  to  be  entirely  practical  even  though  it  may  entail  the  simultaneous  solution 
of  several  thousand  equations.  Except  for  the  collapsing  algorithm,  the  development  of 
the  normal  equations  for  our  present  solution  remains  largely  the  same  as  in  the  writer's 
original  papers  of  1958  and  1959.  However,  a  number  of  refinements  hove  been  added, 
foremost  of  which  is  a  generalized  treatment  of  auxiliary  observations  which  permits  the 
introduction  of  any  desired  statistical  or  functional  constraints  on  the  parameters  of  the  ad* 
justment.  Before  we  take  up  the  central  problem  of  the  solution  of  the  normal  equations, 
we  shall  incorporate  these  refinements  into  the  derivation  of  the  normal  equations.  Here 
it  is  appropriate  tonotethat  the  extension  of  the  adjustment  outlined  in  Brown  (1959)  was 
given  without  proof,  an  omission  which  has  led  to  a  number  of  private  requests  for  clari¬ 
fication.  As  we  shall  see  in  the  development  to  follow,  the  proof  of  the  extension 
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Is  so  embarrassingly  simple  os  to  be  elusive.  This  is  why  It  was  not  discovered  until 
shortly  after  the  publication  of  the  originol  solution.  In  briefs  it  involves  nothing 
more  than  recognition  of  the  fact  that  the  adjusted  values  of  any  observations  may 
be  carried  In  the  adjustment  as  unknown  parameters. 


1.02  THE  ELLIPSOIDAL  CONTROL  POINT 


In  the  formulation  of  the  general  photogrammetri c  adjustment,  we  shall 
admit  the  possibility  of  correlated  observations.  Properly  exploited,  the  admissi¬ 
bility  of  correlated  observations  provides  the  investigator  with  o  convenient  and 
flexible  means  for  rigorously  implementing  any  manner  of  variation  in  the  basic 
measuring  proceues  without  requiring  the  least  alteration  of  the  general  adjust¬ 
ment  itself.  We  shall  utilize  this  tool  at  the  very  outset  to  introduce  a  concept 
fundamental  to  our  approach,  namely  that  of  the  'ellipsoidal  control  poini.' 
According  to  this  concept,  the  metric  properties  of  o  contro;  point  X  ,  V,,  Z 

it* 

•  • 

ore  fully  characterized  by  its  covariance  matrix  Aj,  the  elements  of  which 
specify,  in  effect,  the  relative  statistical  magnitudes  and  interactions  of  the 
errors  in  the  coordinates.  The  term  elliD«oHcj*  control  point  stems  from  the 
considerction  that  the  following  quodrcflc  form 


(1)  q  = 


**-l  T 

A,  A, '  a: 


(X,-X0  Y-Y^  Zj-Zj) 


^ rt  .  .  .  rr  _ 


y; 


defines  an  ellipsoid  centered  at  the  observed  point  X°,  Y^,  Z®  ,  By  incorpor¬ 
ating  this  quadratic  form  into  the  general  quadratic  form  of  the  adjustment,,  one 
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constraint  the  adjusted  rays  from  the  various  cameras  to  a  given  control  point 
to  intersect  in  probability  vrithin  the  space  allovred  by  the  'error'  ellipsoid 
associated  with  the  point.  The  concept  of  the  ellipsoidal  control  point  erases 
the  usual  distinction  betw'een  different  types  of  control  points.  The  difference 
between  an  absolute  control  point  at  the  one  end  of  the  spectrum  and  o  relative 
control  point  at  the  other  becomes  merely  one  of  degree.  In  the  case  of  on 
absolute  control  point,  the  dimensions  of  the  error  ellipsoid  for  a  moderate 
level  of  probability  would  be  quite  small  (perhaps  on  the  order  of  millimeters), 
whereas,  in  the  cose  of  a  relative  control  point,  the  dimensions  would  be  com¬ 
paratively  large  (perhaps  on  the  order  of  hundreds  of  meters).  Partially  absolute 
control  points  are  characterized  by  either  extremely  flattened  (poncake  shaped) 
error  ellipsoids  for  the  case  when  only  one  of  the  three  coordinates  is  known 
accurately,  or  else  by  extremely  elongated  (cigar  shaped)  error  ellipsoids  for 
the  case  when  two  of  the  three  coordinates  are  known  accurately. 


The  ellipsoidal  control  point  provides  a  particularly  convenient  means 
of  introducing  either  absolute  or  partial  control  expressed  originally  in  terms  of 
geographic  coordinates  (0^  ^  rather  thon  Cartesian  coordinates  (Xj,Y^,Zj). 

If  ‘J*^/X®,h®  denote  the  ‘ observed*  geogrophic  coordinates,  the  corresponding 
Cartesian  co^dinotes  ,  Z®  ,  may  be  expressed  functionally  as 


(2) 


yO 


X,  h®)  , 

Y,  (<^,x;,  hj)  , 


If  the  covariance  matrix  of  the  geographic  coordinates  is 
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(3) 


a  o 

<>,  0^,  «,  h, 


I  *1 


\\  % 


that  of  the  derived  Cartesian  coordinates  becomes 
(4)  A,  -  U,  T,  u| 

wherein 


axj 

ax5 

ax5 

d<(P^ 

axj 

ah5 

avj 

aY5 

aY5 

305 

ax5 

ah5 

az5 

az5 

az5 

305 

ax5 

ah5 

The  covariance  matrix  contains  all  of  the  information  pertinent  to  the  error 
structure  of  the  geographic  coordinates.  In  the  event  that  only  one  of  the  three 
geographic  coordinates  were  known  accurate!//  one  could  proceed  by  assigning 
comfortably  large  variances  to  available  approximations  for  the  two  poorly  known 
coordinates  and  o  realistic  variance  to  the  known  coordinate.  The  transformed 

e  e 

covariance  matrix  would  then  contoin  the  information  that  one  of  the  three 

geographic  coordinates  is  known  with  worthwhile  accuracy  while  the  other  two 


”8“ 


"  y 


are  known  only  nominally.  The  nonzero  off-diagonal  elemenh  of  ore  par¬ 
ticularly  vifol  to  the  correctness  of  the  solution  for  they  define  the  orientation 
of  the  error  ellipsoid. 

By  applying  the  concept  of  the  ellipsoidal  control  point  to  geographic 
coordinates,  one  circumvents  the  awkward  conventional  alternative  of  forcing 
rays  to  intersect  with  mathematical  precision  on  quadric  surfaces,  cones  and 
planes.  Upon  reflection,  one  begir  .  to  appreciate  that  in  the  real  world 
absolutely  perfect  control  simply  does  not  exist;  all  control  is  subject  to  error 
of  varying  degree.  Moreover,  there  is  really  no  essential  distinction  between 
an  approximation  and  an  observation,  for  one  can  arrive  at  approximations 
only  through  a  process  of  observation,  however  crude  and  however  indirect. 
Thus,  approximations  may  be  viewed  as  observations  having  large  apd  uncertain 
variances.  We  shall  adopt  this  view  throughout  the  development  of  the  general 
photogrammetric  adjustment. 


1.03  observational  equations  generated  by  the  projective 

REL/^TIONS 

As  in  Brown  (1958)  we  consider  the  photogrammetric  neJ  to  involve  a 
total  of  m  exposure  stations  and  a  total  of  n  control  points.  We  shall  employ 
the  subscript  i  ( i  =  1 , 2, . . .  ,m)  to  denote  the  exposure  station  and  the  sub¬ 
script  }  ( j  =  1 , 2, . . .  ,n)  to  denote  the  control  point.  When  double  subscripts 
are  used,  the  first  will  refer  to  the  station  and  the  second  to  the  control  point. 

No  restrictions  are  placed  on  camera  orientations  or  on  the  nature  and  distribution 
of  control.  We  shall  proceed  at  the  outset  as  if  every  control  point  were  recorded 
at  every  station.  Later  this  assumption  will  be  dropped. 

The  projective  equations  arising  from  the  control  point  and  i  station 
are  shown  in  Brown  (1958a)  to  be  of  the  form 
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(6) 


li 


X  +  c 

Pi  ‘ 


1) 


S 


where 


(7)  ,y,j 


plate  coordinates  of  point  on  photO/ 


Pi  Pi 


(8)  ,y 

(9) 


plate  coordinates  of  principal  point  of  i^^  photo, 


principal  distance  of  photo, 


(10) 


A,  «,  c, 

a;  b;  c; 

0,  E.  f. 


orientation  matrix  of  i^^  photo. 


(11) 


11 


1  j 


11 


1 


'x.  -  xf 

Y,-Y' 


direction  cosines  of  ray  joining  i 


th 


exposure  station  at  ,  7. ^ 

and  control  point  at  X,,  Y  ,  Z 

4  i  4 


(Ri,  =  1  (Xj -X^l^MYj -Y^l^MZj 


The  elements  of  the  orientation  matrix  are  functions  of  the  three  angular  elements 
of  orientation  O',,  . 
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All  steps  leading  to  the  formotion  and  collection  of  the  entire  set  of 
linearized  observational  equations  arising  from  the  projective  relations  will 
proceed  precisely  as  in  our  earlier  solution.  Thus,  we  let  denote 

measured  plate  coordinates  and  set 


(12) 


It 


V 


X 


11 


y.i 

y.! 

(t  = 

1/2,...,  m^ 

1=1 

,2, 

•  •  •  /  n) 

where 

the  v* 

s  are  observational 

residual 

s.  Si 

milarly,  we 

set 

=  of 

X  = 

P, 

x“ 

Pi 

+  8x 

Pi 

< 

= 

(X^)“ 

(13) 

+  8cl!j 

00 

’'p. 

+  8y 

P| 

vr 

= 

(yC)OO 

=  Kf 

+  8Kj 

'i  " 

00 

Cj 

+  8c, 

= 

(Z^)“ 

+  6X^ 


+  8Y 
+  8Z 


(i  =  1,2 


in  which  arbitrary  approximations  are  signified  by  the  superscript  and 
the  8's  are  the  appropriate  corrections  to  the  opp'oximations.  We  likewise 
assume  approximations  are  available  for  the  coordinates  of  the  control  point 
and  set 


Xj  =  X"  +  8Xj  , 


(14)  Yj  =  Y^  +  8Y,  , 


Z,  =  Z~  .  8Z,  . 


The  substitution  of  equations  (12),  (13),  (14)  into  (6)  arxl  subsequent  linearization 
by  Taylor's  series  leads  to  the  observational  equations 
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V  +  B  6  B  6 

ij  il  i  li  j 


Cjj  (l  /  J  1/2/aaa/n) 


in  which 


6X, 

0  00 

X  -  X 

•  • 

1  i  1 J 

6Y, 

1 

J 

1 

wO  wOO 

(3,1) 

(2,1) 

The  partial  derivatives  in  B^^  and  B^^  are  evaljated  at  the  appraximotions 
,  etc.  The  quantities  x*  ,  in  ^  denote  the  values  resulting 
when  the  right  hand  sides  of  equations  (6)  are  evaluated  using  the  approx¬ 
imations.  Detailed  expressions  for  the  partial  derivatives  ore  given  jn  Q.jr 
earlier  paper  (Brown  1958)  and  need  not  be  repeated  here. 

At  this  point  a  comment  on  notation  is  appracriate.  Throughout  tne  paper 
we  shall  continue  the  practice  (already  begun)  of  affixing  the  superscript  to 
quantities  which  are  considered  to  be  observed  and  the  superscript  ‘  to  quantities 
which  are  considered  to  be  approximations  or  the  result  of  approximations  (as,  for 
example,  in  the  quantities  x^^,  y^^  which  denote  the  plate  coordinates  computed 
from  approximate  elements  of  orientatior*  and  approximate  cootdinates  of  control). 
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shall  denote  the  covariance  matrix  of  the  date  coordinates  ^ 


(18) 


A  = 

It 


0* 

X 


II 


^I^IJ 


Njy.t 


0* 

yii 


and  shall  define  the  weight  matrix  of  x® ^ ,  y®^  to  be 


(19) 


0 


By  allowing  the  f  .re  coordinates  for  a  given  point  to  be  correlated,  we  odmit 
a  variety  of  possible  phte  measuring  techniques  (e.g.,  goniometric,  polar 
coordinate)  in  addition  to  those  which  directly  produce  Cartesian  coordinates. 
We  also  thereby  admit  the  possibility  of  employing  cameras  which  do  not  hove 
flat  fields  (e.g.,  panoramic  cameras,  meteor  cameras.  Baker  Nunn  Satellite 
Tracking  Cameras,  CZR  cameras),  for  here  the  plate  coordinates  to  be  carried 
in  tne  adjustment  would  be  those  derived  from  the  appropriate  transformation 
(usually  from  cylindrical  to  plane  coordinates)  of  the  original  film  meosurements. 
In  general,  if  ^®  j,  ij®^  denote  the  measured  coordinates  of  an  image  in  what¬ 
ever  coordinate  system  is  appropriate  to  the  camera  or  measuring  method  and  if 


(20) 


’‘5i  ' 


define  the  transformation  toCortesion  coordinates,  the  covariance  matrix  of  the 
derived  plate  coordi notes  is  given  by 

(2')  cj, , 

where 
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By  employing  the  fyll  covoriar.ne  matrix  in  conjunction  with  the  derived  plate 

coordinates,  we  correctly  propagate  and  preserve  the  informational  content  of  the 
original  observations  throughout  the  entire  photogrammetric  adjustment. 

Returning  now  to  the  linearized  projective  equations  (15),  we  may  express  the 
entire  set  of  such  equations  generated  by  all  m  exposure  stations  as 

(23)  8  -  B,  8]  = 


Inasmuch  as  we  shall  assume  independence  of  plate  coordinates  of  different 
images,  we  may  express  the  covariance  and  weight  matrices  for  the  composite 
observotiooal  vector  for  the  point  as 
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If  next  we  collect  all  equations  generated  by  all  control  pointy  we 
shall  arrive  at  the  system 

(26)  V+B6+B6  =  € 


in  which 


The  corresponding  covariance  and  weight  matrices  are 


Equations  (26)  and  (22)  contain  the  entire  store  of  information  provided  by  the 
projective  equations.  Our  original  treatment  of  the  adjustment  of  a  photogram- 
metric  net  (Brown,  1958o)  was  based  entirely  on  these  equations. 
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1.04  OBSERVATIONAL  EQUATIONS  GENERATED  BY  ELLIPSOIDAL  CONTROL 
POINTS 

We  shall  now  turn  to  other  pouible  sources  of  information.  If  we  regard 
the  coordinotes  of  the  control  point  as  also  being  available  from  independent 
external  observations/  we  may  write 


X°  + 


(29) 


Y.  = 


Y®  +  vv 


Z.  = 


z; .  V 


Here,  as  before,  ,  Y^ ,  denote  the  adjusted  coordinates.  The  observed 

coordinates  are  X®,  Y^ ,  Z®  arxl  their  observational  residuals  are  ''x  '  * 

J  J  J 

The  covariance  matrix  of  the  observed  cocrdinates  is  and  the  weight  matrix 

ee 

is  Wj  .  As  we  saw  in  our  discussion  of  the  ellipsoidal  control  point,  by  permitting 
the  covariance  matrix  to  be  filled,  we  gain  a  new  measure  of  observational 
flexibility.  Equations  (2^,  simple  though  they  are,  constitute  the  observational 
equations  arising  from  externally  observed  control  points.  By  employing  the 
expressions  in  (14)  for  the  adjusted  coordinates,  we  may  replace  (29)  by  the  equiv¬ 
alent  relations 


-t-  6X. 


(30)  Y^  +  6Yj 


Z®®  +  6Z 

J 


J 


''Y 

J 


-16- 


or 


-  SXj 


(31) 


Vy  -  6Y 
1 

-  6Z 


=  € 


wh®r« 

(32) 


yOO  yO 


«v  “  v«  -  Y«  , 


J  J 


zOO  .zo 
1  J 


W®  shall  ®xpr®si  (31)  in  matrix  form  ot 


(33) 


®® 


Th®  obs®rvatianal  ®quations  arising  from  ind®p®nd®ntly  obtainod  coordinatM 
of  all  n  control  points  or®  th®n  giv®n  by 


(34)  V  -  5  =  €  , 


where 


•  • 

•  • 

•  • 

6i 

•  • 

•  • 

Cl 

•  • 

(35)  V  = 

''2 

•  e 

,  6  = 

^2 

•  • 

,  c  = 

C2 

(3n,1) 

• 

• 

• 

•  • 

V 

n 

(3n,l) 

• 

• 

• 

•  • 

8 

n 

(3n,1) 

• 

• 

• 

•  • 

€ 

n 
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If  we  were  to  assume  that  the  coordinates  of  different  points  ore  independent 
of  each  other,  the  covariance  and  weight  matrices  associated  with  the  obser¬ 
vational  vector  of  (34)  would  assume  the  forms 


— 

r  1 

•  • 

•• 

A^  0  ...  0 

W,  0  ...  0 

•  • 

0  Aj  ...  0 

•• 

o 

• 

• 

• 

o 

A  = 

,  W  = 

(3n,3n) 

•  e  • 

•  •  • 

•  e  • 

(3n,3n) 

•  •  • 

•  •  • 

•  •  • 

•  • 

00  ...  A 

0  0  ...  w 

n 

n 

1.05  OBSERVATIONAL  EQUATIONS  GENERATED  BY  ELEMENTS  OF 
ORIENTATION 

It  is  clear  that  we  could  proceed  os  in  the  preceding  section  to 
introduce  any  independent  observotions  which  may  be  available  for  elements 
of  orientation.  We  shall  assume  initially  that  independent  observations  ore 
available  for  all  elemertts  of  orientation  for  all  exposure  stations.  If  ,  . . 

denote  observed  elements,  we  may  write  the  observational  equations  for  the  i 
station: 


or  =  Qf  O  +  V  ,  X  -  +  v  , 

O.  Pf  P.  ^p 


1  I 


(37)  u,,  = 


y  -  y''  *  V  , 

^P.  ^P.  /p, 


y"  =(y;)°-VyC  , 


' 
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where  the  v's  ore  observational  residuals.  If  we  eliminate  the  adjusted 
observations  from  equations  (13)  and  (37),  we  shall  arrive  at  the  equivalent 
set  of  observational  equations: 


V  -  6of, 

Oft  ‘ 


(38)  V  -  8u}, 

'  '  U}  • 


J>o  J> 

cr,  -  a, 


u/»  -  J 

I  I 


VzC  -  8Z, 


C\00 


(z;y 


^ith  obvious  notation  we  may  represent  these  in  matrix  form  as 

(39)  -  8,  =  €,  . 

The  observational  equations  for  all  m  stations  are  then 

(40)  V  -  6  =  € 


w 


here 


(41)  V  = 
(9m,  1) 


“  - 

*•  • 

• 

''1 

• 

• 

• 

• 

^2 

82 

• 

,  6  - 

• 

• 

,  e  = 

• 

• 

• 

(9m,  1) 

• 

• 

(9m,  1) 

• 

• 

• 

• 

• 

V 

8 

€ 

m 

m 

L  "“J 
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We  shall  let  A  denote  the  covariance  matrix  of  the  observations  of  the 

*  th  • 

elements  of  orientation  for  the  »  station  and  shall  let  Wj=  Aj  denote 

the  corresponding  weight  matrix  .  We  shall  not  require  that  these  matrices 

necessarily  be  diagonal.  We  shall  assume,  for  the  time  being,  that  the 

observations  of  elements  of  orientation  ore  independent  from  one  station 

to  another.  Then  the  covariance  and  weight  matrices  for  the  observed 

elements  of  orientation  can  be  written 


•  e 

Wc  shall  ultimately  allow  A  and  W  to  be  completely  filled  matrices. 


1.06  NORMAL  EQUATIONS  IN  THE  ABSENCE  OF  DATA  FROM  EXTERNAL 
SENSORS 

We  now  have  developed  the  observational  equations  arising  from 

(a)  measured  plate  coordinates, 

(b)  ellipsoidal  control  points, 

(c)  independently  determined  elements  of  orientation. 

We  have  yet  to  consider  still  another  potential  source  of  information  which  moy 
be  applicable  to  the  photogrammetnc  odjustment;  namely,  external  sensors  and, 
in  particular,  external  sensors  which  may  themselves  be  significantly  biased  and 
which  may,  therefore,  need  to  be  calibrated  as  part  of  the  overall  photogrammetri c 
adjustment  in  order  that  their  potential  accuracies  might  be  fully  realized.  Before 
we  turn  to  such  considerations,  we  shall  pause  briefly  to  consider  the  form  of  the 
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normal  equations  generated  b/  the  observational  equations  developed  thus  far. 
The  three  sets  of  observational  equations,  namely. 


V  +  B  6  B  6 

(43)  V  -  8 

•  •  •  • 

V  -  6 


€  (linearized  projective  equations) 

€  (constraints  on  elements  of  orientation) 

•  • 

€  (constraints  from  ellipsoidal  control  points) 


may  be  mecged  into  the  single  matrix  equatian 


and  this  in  turn  may  be  reduced  to 


(45)  V  +  B6  =  € 


where,  with  obvious  notation 


V 

• 

a  •  • 

B  8 

• 

6 

€ 

• 

(46)  V  - 

V 

/  B  = 

-1  0 

,  6  = 

a  • 

,  f  = 

€ 

(no/ no) 

•  • 

V 

(no,  1  ) 

0  -1 

(Po, 1) 

6 

(no,  1  ' 

•  • 

€ 

where  n^  =  2mn  +  9m  +  3n,  pg  -  9m  +  3n, 

In  a  similar  manner  we  may  merge  the  covariance  matrices  and  weight 
matrices  of  the  three  basic  observational  vectors  into  the  single  composite  matrices 
A  and  where 
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(47) 


(50) 


71  = 

(no/iTo) 


A 

(2mn,  2mn) 

0 

1 

o  o 

o  •  <, 

,  W  = 

A-'  = 

W  0 

(^n,  2mn) 

• 

0  w 

0 

0 

0 

(9m, 9m) 

e* 

0  A 

(3n,3n) 

(no/Oo) 

(no/ no) 

(9m, 9m) 

0  0 

e  e 

W 

(3n,3n) 

The  normal  equations  leading  to  the  determination  of  that  pair  of  vectors  v,  6  which 
satisfy  (45)  while  simultaneously  leading  to  the  minimization  of  the  quadratic  form  of 
the  residuals 


(48)  s  =  W  V 


is  shown  in  Brown  (1955)  to  consist  of 


(49)  Wl)  6 


W  €  . 


By  virtue  of  (46)  and  (47)  the  normal  equations  may  be  written 


•J 

B  -I  0 

'  ’T 

B  0  -I 


WOO 

« 

0  W  0 

•  e 

0  0  w 


B  B 
-I  0 
0  -I 


e 

'T 

8 

B  -1  0 

•  • 

’  1  « 

6 

B  0  -1 

w 

0 

0 


0  0 

W  0 

e  e 

0  w 


which,  upon  reduction,  become 

(51) 


r.  .  "1 

m  « 

e 

e  e  e 

N  +  W 

R 

5 

c  -  W  € 

f5' 

ee  ee 

N  +  W 

ee 

6 

ee  ee  ee 

-  W  €  _ 

L  J 

wherein 
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f 


.  .J  ... 

N=B  W  B,c  =  B  W  € 

(9m, 9m)  (9m,2mn)(2mn,2mn)(2mn,9m)  (9m, 1)  (9m,2mn)(2mn,2mn)(2mn,1) 

(52)  R  =  B^  W  B  , 

(9m, 3n)  (9m,2mn)(2mn,2mn)(2mn,3n) 

N=B  W  B,c=B  W  €. 

(3n,3n)  (3n,  2mn)(2mn,  2mn)(2mn,3n)  (3n,1)  (3n,2mn)(2mn,  2mn)(2mn,  1) 

The  normal  equations  (51)  are  of  the  form  described  in  our  eorlier  poper  (Brown,  1959). 
We  shall  temporarily  defet  the  further  treatment  of  the  normal  equations  until  Subsection 
(1.12)  and,  in  the  next  three  subsections,  shall  consider  the  extension  of  the  basic  solu¬ 
tion  to  incorporate  information  from  external  sensors. 


1.07  OBSERVATIONAL  EQUATIONS  GENERATED  BY  AUXILIARY  EXTERNAL  SENSORS 


For  the  soke  of  complete  generality,  we  shall  now  consider  the  possibility 
that  there  may  be  certain  auxiliary  meosurements  interrelating  elements  of  orientation 
and  coordinates  of  control.  For  instance,  the  distances  between  certain  pairs 
of  exposure  stations  may  be  known,  or  distances  between  certain  pairs  of  con¬ 
trol  points,  or  even  distances  between  certain  exposure  stations  and  certain 
control  points.  It  is  altogether  likely  in  the  near  future  that  the  relative  posi¬ 
tions  of  successive  aerial  exposure  stations  will  be  measured  with  worthwhile 
accuracy  by  inertial  sensors.  Conceivably,  the  effectiveness  and  accuracy  af 
such  sensors  could  be  increased  if  certain  parameters  peculiar  to  the  sensors 
were  carried  as  unknowns  in  an  appropriate  modification  of  the  photogrammetric 
adjustment.  To  enlarge  on  this,  let  us  consider  on  inertial  system  in  samewhat 
greater  detail.  The  output  of  an  inertial  navigational  system  of  high  quality 
has  0  very  low  random  component,  but  is  subject  to  a  cumulative  time  varying 
error  upon  which  may  be  superimposed  a  sinusoidal  type  of  error  having  the 
Schuler  period  P  (approximately  84  minutes  near  the  earth's  surface).  Strictly 
for  purposes  of  discussion,  let  us  assume  that  the  following  equations  adequately 
describe  the  nature  of  the  errors  in  the  navigational  output  for  the  latitude  0^ 
ond  longitude  of  the  exposure  of  a  photogrammetric  strip: 


(53) 


0,  - 


27r  27r 

+  Qo  +  a,  (tj-too)  +  Op  sin-p- (tj-too)  +  03  cosj— (tj-too) 


(true)  (meosured)  (random 
error  ) 


+  higher  order  terms, 
(assumed  negligible) 


X,  -  x» 


-*■  bo  +  b,(rj-too)  +  b^  sin-p- (tj-too)  +  bj  cos-p2-(t|-too) 


(true)  (measured)  (random 

error ) 


+  higher  order  terms  . 
(assumed  negligible) 
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In  these  equations 

,  th 

time  or  i  exposure/ 

arbitrary  time  of  reference  which  would  normally  be 
selected  to  correspond  to  a  time  near  the  center  of  the 
strip, 

zeroing  errors  at  time  tj  =  too  (ordinarily  ao»a5,  bo»b3), 

coefficients  of  first  order  secular  d-ift, 
coefficients  of  first  order  periodic  drift . 

Let  US  further  suppose  that  the  altitude  of  the  aircroft  is  measured  by  means  of 
a  precise  pressure  altimeter  and  that  a  nominally  constant  altitude  is  flown. 

Aside  from  zeroing,  the  systematic  errors  in  pressure  altitude  are  primarily 
attributable  to  the  slowly  changing  departure  of  the  isobaric  surface  at  flying 
height  from  the  spheroid  of  reference.  If  s^  were  to  denote  the  distance  along 
the  flight  path  of  the  exposure  station  (s=0  when  t=too),  o  suitable  error 
model  for  measured  pressure  altitudes  might  well  be  of  the  form 

(54)  \  +  ^.c,s,+  C2s;*C35;  +  ... 

I 

(true)  (measured)  (random  equations  defining  isobaric 

error)  departure 'a  long  flight  line_ 

from  reference  spheroid. 


t 

1 

foo 

00-^03 

bo+bj 

o,  ,bi 

02,03 

b2,b3 
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If  the  velocity  of  the  oircroft  were  nearly  constant/  one  could  replace 
in  this  equation  by  s^  =  v(tj-too)  where  v  denotes  the  average  velocity 
along  the  flight  interval.  By  means  of  appropriate  transformations  the  above 
equations  for  0,  /  ^,  /  could  be  expressed  in  terms  of  Cartesian  coordinates. 
ThuS/  we  may  write  functionally 


(55) 


Z 


c 

1 


^0  /  '  QO  /  «!  /  •  •  •;  bo  /bi  /  *  •  •;  CO  /  Cl  / . . .;  tj )  . 


Here  we  have  expressed  the  adjusted  Cartesian  coordinates  for  the  •  exposure 
station  in  terms  of  independently  determined  geographic  coordinates  together 
with  a  set  of  unknown  error  coefficients  necessary  for  their  calibration.  Equations 
(55)  may  therefore  be  considered  to  constitute  another  set  of  observational  equa¬ 
tions  involving  not  only  parameters  heretofore  considered  (X^/  Y^/  Z^)  but  also 
a  new  set  of  parameters  (a^ ,  b^,  c^)  independent  of  the  parameters  of  the  photo- 
granmetric  model  proper.  Nothing  in  principle  prevents  us  from  incorporating 
such  observational  equations  in^o  the  photogrammetric  adjustment.  By  doing  so, 
we  may  possibly  strenp'  len  the  photogrammetric  adjustment  to  a  worthwhile  degree 
and,  in  the  process,  calibrate  the  external  sensors  over  the  flight  interval  employed. 


The  above  discussion  is  intended  to  provide  a  heuristic  introduction 
to  the  next  phase  of  our  formulation  of  the  general  photogrammetric  adjustment, 
namely  the  incorporation  of  observational  equations  arising  from  external  sensors. 
We  postulate  the  existence  of  a  general  observational  vector 

(56)  O®;  ...  ) 
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r 


provided  by  on  unspecified  combination  of  unspecified  external  sensors. 

We  shall  assume  that  the  adjusted  values  external 

k 

observations  must  satisfy  o  set  of  r  equations  of  the  general  functional 
form 


(57)  f|^(^  ] 2  /  •  •  • /^p/  ui/Uj/i 


/ ^2 '  *  •  •  ^ » ^^2  *  *  *  *  ^ ^  ~  ^ 


in  which 


U|  i  U2  /  •  •  •  /  Ugm 

••  ••  •• 

i>|/U2/ee«/^}a 

•••  •••  ••• 


elements  of  orientation  (e.g./  m  =  /  U2=u^l/  etc.) 

coordinates  of  control  (e.g.,  u^=‘Xi,  U2“^t'  *fc.) 
unknown  porometers  peculior  to  the  externol  senson. 


To  linearize  equations  (57),  we  set 


(58) 


u. 


•  •• 

u. 


•40  j.  c** 

Uj  +  OUj 


u^  +6u^  , 


1  =  1,2,... ,9m, 
1  =  1,2,...,3n, 
*'  “  1/2, ...,q  , 


e 

in  which  the  approximations  for  the  elements  of  orientation  u^  and  coordinates 

of  control  u^**  are  the  same  values  as  were  used  in  the  linearization  of  the 
projective  equations.  The  substitution  of  these  expressions  together  with  the 
expressions  0^^  =  ^  equations  (57)  and  subsequent  linearization 

by  Taylor's  series  yields 
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•  • 


(59)  ...  +  apgv.  +  f,g  6u,  +  f2g  Su^  +  •  •  •  +  fg^^g  809^ 


•  •  •• 


+  f,g6u,  +  f^g  6u2  +  . . .  +  f3n,g  Syjn 


•••  •••  •••  ••• 

+  f,g  6u,  f2g  6u2 


+  ^q,g  8Uq 


=  € 


where 


(60) 


gH 


df 


30. 


9^ 


3f 


3u, 


gh 


3f 


du, 


'  V 


3f 


3  u, 


(61) 


t  /  flO  /jO  43  *00  *00  •  00  'lao  'TK)  "loo  "loo 

i  (0j/02^  «••  /  Uj/  U2f  •••  /  •J2/«tt  /  i^n  /  U2/»»»  /  u  ) . 

y  ' 


Equations  (39)  niay  be  expressed  in  matrix  form  os 

•  •  ee  ee  e««  ••• 

e  •• 

where  8  and  6  ore  the  satre  os  in  (24)  and  (27)  respectively  and 


“ 

— 

- 

— 

• 

Oil 

0\2  •  •  • 

''01 

fll 

fj  2  •  •  • 

9m 

/ 

(63) 

II 

021 

e 

• 

• 

O2  2  •  * • 

• 

• 

• 

°^P 

• 

• 

e 

'V 

(pJ) 

''02 

• 

• 

• 

'  V 

(r  ,9m) 

^21 

• 

• 

e 

^22  ••• 

• 

• 

• 

• 

^2, 9m 

• 

• 

• 

ori 

0r2  • •  • 

“rp 

-0^'" 

1 _ 

• 

fr2  •  •  • 

• 

^r  ,  9n> 

-28- 
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We  ihall  let  the  covariance  and  weight  matrices  of  the  observational  vector  9 
be  denoted  by  A0  and  W0  =  A0^  , 


By  means  of  equations  (62)  we  can  introduce  into  the  photogrammetric 
adjustment  any  pertinent  information  available  from  independent  sources.  For 
example,  in  the  special  cose  considered  at  the  beginning  of  this  section,  the 

e 

matrices  and  B.  would  assume  the  forms 

9  e 
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(67) 


F„  0 

0  F„ 

B  * 

6  • 

(3m,9nn)  I  ! 


0 


wh«re  Fj  j  = 
(3,9) 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

•Ji-5,?j-2 

ft.  0* 

• 

* 

• 

^3l-2,9t  -1 

^31-1,91-1 

^3i  ,9i 

. 

. 

^3* -2,9* 

f3*-l,9i 

^3  i  ,  9l 

Execute  no  control  points  ore  involved  in  equotions  (55),  the  matrix  B  would  be 

0 

o  zero  matrix.  Since  the  u^s  (the  o^  ,bj  ,Cj  in  the  present  cose)  ore  common  to 

•  •• 

oil  equations,  the  matrix  would  be  o  completely  filled  3m  by  q  motrix,  where 
q  would  equal  12  if  four  parameters  were  carried  in  eoch  of  the  error  models  of 
(53)and\54). 

Inosmuch  os  different  strips  of  o  block  moy  be  flown  on  different  occo- 
sions,  it  may  be  necessary  to  employ  fresh  coefficients  in  the  error  models  for 
each  strip  or  subgroup  of  strips.  This  situation  is  eosily  occommodoted  by  o 
reinterpretation  of  (62),  (65),  (66),  ond  (67).  We  now  ottoch  o  subscript  i 
to  the  matrices  defined  in  (64) ,  (65) ,  (66)  to  signify  thot  they  orise  fromthe 
strip  or  group  of  strips  for  which  the  set  of  error  coefficients  apply. 

If  we  postulate  that  the  block  is  subdivided  into  o  total  of  s  subblocks,  each 
having  o  re-initialized  error  model  for  the  external  sensors,  the  matrices  in 
(62)  auume  the  forms 
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(68) 


A  = 

j 

o  o 

e  • 

e  e 

e  e 

o  < 

<  o 

1 _ 

/  V  = 

V 

V 

02 

,  B  = 

e 

B 

e 

B 

«2 

e 

•  e  • 

e  e  e 

e  •  e 

0  0  ...  A 

9 

•  •  •  > 

_ 1 

0 

e 

e 

e 

e 

B 

4 

(69) 


eee 

eee 

B,  0 

eee 

0  B; 

r\ 

eee 

...  0 

•  •• 

.  6  = 

r 

°\ 

eee 

62 

'  = 

€ 

01 

% 

e  e 

e  e 

e  e 

0  0 

e 

e 

e 

eee 

...  Bj 

e 

e 

e 

eee 

6 

s 

0 

e 

e 

e 

\ 

— 

-* 

>  .e 

••• 

Here  6^  refers  *o  the  corrections  to  the  >  set  of  error  coefficients  (these  apply 
only  to  the  syb-block).  In  the  present  application  the  elements  Vn  /  €  of 

th 

the  vectors  v^,  ^  are  themselves  vectors  (applying  to  the  >  sub-block)  ar>d  are  not 
to  be  confused  with  the  scalars  v^  ,  ^  appearing  in  {57}  (these  should  now  be  rede¬ 
fined  as  Vrt  ,  €  to  refer,  respectively,  to  th#  residual  and  discrepancy  term 

arising  from  the  t  sub-block). 


From  the  foregoing  exomple  it  should  be  clear  that  equations  (62)  may  be 
interpreted  with  sufficient  generality  to  accommodate  any  available  auxiliary  data 
pertaining,  however  remotel'/,  to  any  of  the  elements  of  orientation  or  to  any  coor¬ 
dinates  of  control .  * 
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1.08  OBSERVATIONAL  EQUATIONS  GENERATED  BY  APRIORl 
KNOWLEDGE  OF  PARAMETERS  OF  ERROR  MODELS 


Our  final  Mt  of  observational  equations  is  intended  to  exploit  any 
information  that  may  be  available  concerning  the  admissible  voriation  of  the 

coefficients  of  error  models  of  external  sensors.  We  assume  that  the  parameter 

••• 

u^  is  itself  subject  to  observation  and  write 


eee 

(70)  u. 


k  =  U2, 


.q. 


ee  e 

Upon  eliminating  u^^  from  equations  (58)  ond(70)  we  get 


which  may  be  expressed  in  matrix  form  as 


(72)  V  -  6 

(q/))  (q/1) 


€ 

(qJ) 


tee  eee 

We  shall  let  A  and  W 


”’-1 

A  denote  the  covariance  and  weight  matrices 


(q,q)  (q,q)  (q,q) 

of  Ine  a  priori  values  of  the  error  coefficients.  In  the  event  no  a  priori  constraints 

eee 

were  to  be  placed  on  the  error  coefficients,  W  would  become  zero.  By  the  same 
token,  if  no  constraints  were  to  be  placed  on  a  particular  error  coefficient,  the 


rows  and  columns  of  W  corresprnding  to  that  coefficient  would  consist  of  zero 

elements. 
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1.09  THE  MERGED  OBSERVATIONAL  EQUATIONS 


Bringing  together  the  various  sets  of  observational  equations  which 
may  apply  to  the  adjustment  of  a  general  photogrammetric  net,  we  hove 


/~>n\ 


V  +  B  6  +  B  8 

e  e  eeee  eee 

Av  +  B5+B6+B8 

e  e  e  e  e 


•  e« 

V 


6  = 


=  €  (See  Section  (1 .03)) 

=  €  (See  Section  (1 .07)) 

9 

=  €  (See  Section  (1 .05)) 

=  €  (See  Section  (1 .04)) 

€  (See  Section  (1 .08)) 


These  may  be  written 


(74) 


o 

o 

o 

V 

^6  *§  o' 

r 

I 

m 

_ I 

0  A„  0  0  0 

V^ 

•  ••  ••• 

• 

8 

€- 

u 

9 

9  0  9 

0  0  10  0 

• 

V 

-10  0 

8 

= 

• 

€ 

•  • 

•  • 

0  0  0  10 

V 

0-10 

8 

€ 

•  ee 

L-  ^ 

•  •• 

0  0  0  0  1 

V 

0  0-1 

€ 

which  may  be  represented  more  compoctly  as 
(75)  A  V  +  "B  8  =  ? 
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The  covariance  and  weight  matrices  corresponding  to  the  combined  observational 
vecton  is 


A  0  0  0  0 


WO  0  0  0 


(76) 


7i  = 


0  A  0  0  0 

6 

0  0  A  0  0 

•  • 

0  0  0  A  0 

0  0  0  0  A 


0  0  0  0 

0  0  woo 

•  • 

0  0  0  W  0 

•  •I 

0  0  0  0  w 


All  of  the  information  pertinent  to  the  adjustment  is  contained  in  equations 
(75)  and  (76). 


1 . 10  THE  GENERAL  NORMAL  EQUATIONS 

The  normal  equations  for  the  minimum  variance  adjustment  are  obtained 
from  the  particular  pair  of  vectors  v,  6  which  simultaneously  satisfy  the  specified 
observational  equations  while  minimizing  the  quadratic  form 

(77)  s  ^  v^  W  V  . 

The  writer  has  shown  (Brown»  1955)  that  the  solution  to  this  problem  leads  to  a  set  of 
normal  equations  of  the  form 

(78)  N  6  =  c  , 


-3A- 


in  which 


(79)  N  =  , 

(80)  c  =  B  ^  ^  * 

If  we  let 

(81)  G  =  ' 

we  can  expresi  the  matrix  (XaX^)  « 

W  0  0  0  0  ’ 

0  G  0  0  0 

e 

0  0  w  0  0 

•  « 

0  0  0  w  0 

0  0  0  0  w 


(82) 


(A^A^r’" 


,hi,  ond  f-o..  th.  implicit  portiticninp 

coefficient  matrix  N  ai 


of?  in  (75)  we  may  expreii  the 


(83) 


N  = 


L“ 


B' 

0 

B*' 

9 

V 

9 


0 

0 


0 


0 


“1 

0 

o 

o 

o 

o 

•  •• 

B  B  0 

•  ee  ••• 

0 

0  G  0  0  0 

B  B  B 

0  0  0 

-1 

1  e 

0  0  w  0  0 

-1  0  0 

■ 

•  • 

0  0  0  w  0 

o 

c 

eee 

0  0  0  ^ 

[o  0  -ij 
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which  reduces  to 


•  •  • 

W  B  B '  G  B^  ^  W 

‘T  “  *T 
B  W  B+  B 

•  • 

G  B 

b' 

•  •• 

G  B 

9  6 

e 

9 

9 

9 

*7 

•  **T  * 

•  •v  ••  **T 

•  •  •• 

*7 

f 

N  = 

B 

W  B  +  B  G  B 

B  W  B  t-  B 

G  B  +  W 

B 

G  B 

6  6 

6 

9 

9 

9 

•? 

• 

G  B 

•  •• 

B  G  B^ 

•? 

•  •• 

G  B 

e 

6 

9  9 

9 

9 

Similarly  we  may  show  that  c  is 

of  the  form 

r- 

—I 

+ 


(85)  c  = 


*T  *T 

B  Wf  +  B 

e 

*7  *7 

B  W€^  e 

e 

•? 

e 


•  • 

w  e 


G€q-  \N  € 

•  ••  •• 

G  -  VV  € 


From  (84)  and  (85)  we  see  that  the  general  normal  equations  (78)  can  be 
expressed  as  the  sum  of  the  following  two  sets  of  normal  equations; 


(86) 


(87) 


• 

N  +  W  R  0 

6 

c  -  W  c 

Y  ••  •• 

N  N  +  W  0 

•  • 

5 

= 

•  •  ••  •  • 

c  -  W  t 
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•  •• 

6 

0 

7 

•  _ 

• 

t 

Z 

IZ 

z 

6 

c 

0  0  0 

0 

-T 

N  N  N 

•  • 

6 

= 

•• 

c 

0  0  0 

3 

-  T  . 

N  N  N  +W 

6 

c  -  W  € 
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0 

. 

V 


in  which 


N  =  y 

• 

W  B  , 

• 

N 

‘T 

=  B  G  B  . 

N  = 

B^ 

•  •  • 

G  B 

e 

0  0 

0 

0 

0 

N  = 

•  • 

W  B  , 

N 

‘T 

=  B  G  B  , 

A 

N  = 

V 

•  •  • 

G  B 
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•  •  **T 

N  =  B 
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W  B  , 
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N 

•  •y  •• 

=  B  G  B  , 
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N  = 

? 

•  •• 

G  B 

6 

0  0 
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0 

•  ’T 

• 

c  =  B 

We  , 

c 

-  B  G  €  , 
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0  0 

•  •  • 

•  • 

"T  ^  ^ 

c  =  B 
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0 

0  0 

•  •  • 

*“T  ^ 

c^ 

=  B  G  €  , 

0 

0  0 

We  recognize  equations  (86)  as  being  those  derived  in  K06  ond  in  our  earlier  papers 
(Brown  19580/1959);  they  arise  from  the  projective  relations  and  from  con¬ 
straints  placed  directly  on  the  elements  of  orientation  and  coordinates  of 
control.  Equations  (87)  reflect  the  combined  contribution  of  those  external 


sensors  not  involved  in  the  generation  of  the  constraining  matrices  W  and  W. 

In  the  case  of  the  Air  Force  USQ-28  system,  for  example,  such  sensors  would 
include:  a  precise  inertial  system  (Hypernas  II)  providing  accurate  measurements 
(a=  10  arc  sec.)  of  the  direction  of  the  camera  axis  relative  to  the  locol  vertical, 
together  with  measurements  of  heading  (Ct=  40  ore  sec.)  ond  of  relotive  position 
(0,X);  0  precise  ranging  system  (SHIRAN)  providing  simultaneous  measurements 
(<7=3  ft.)  of  the  distances  of  the  aircraft  from  up  to  four  ground  stations;  a 
Terrain  Profile  Recorder  providing  o  continuous  meosure  (<7=  10  ft.)  of  the 
distance  to  the  nadir  of  the  aircraft;  a  precise  pressure  altimeter  monitoring  the 
altitude  of  the  aircraft  relative  to  an  isoboric  profile.  Equations  (87)  are  suffi¬ 
ciently  general  to  encompass  all  of  the  sensors  of  the  present  USQ-28  system 
plus  anv  other  sensors  which  might  later  be  added  to  the  system. 
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l.n  DETAILED  STRUCTURE  OF  THE  NORMAL  EQUATIONS 


To  proceed  further  we  (hall  confine  our  consideration  to  normal  equations 
of  the  form  (86).  From  the  portitioning  of  (27),  (28),  (35),  (36),  and  (41)  we  con 
show  that  the  normal  equations (86)  (with  the  third  rows  and  columns  dropped)  ore  of 
the  form 


(89) 


(En,  )  + w 


1=1 


N, 


R. 


N, 


N, 


ee  ee 


N,  +  W, 


ee  ee 


Nj  +  Wj 


N, 


0 

0 


•  e  ee 

n  rs 


1  =  1 


c,  -W,  €, 

e  e  e  e  ee 

Cj  -  W2  ^2 


^n- WnCn 


in  which 


(90)  Rj  =  b[  Wj  Bj  , 

••  eey  •• 

N,  =  , 


ee  ee 


From  the  further  portitioning  of  (24), (25),  ond(42)  we  con  expand  (89)  to  the  form 
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in  which 


The  upper  left  hand  portion  of  the  normol  equations  consists  of  m 
diagonally  arranged  9x9  blacks  of  elements,  eoch  such  block  corresponding 
to  the  elements  of  orientation  for  o  porticulor  exposure  station.  When  the 
elements  of  interior  orientation  ore  rigidly  enforced  to  precolibroted  values 
(as  would  normally  be  the  case  in  aerial  photogrammetry),  the  9x9  blocks 
reduce  to  blocks.  In  generol,  ony  parameter  of  the  normol  equotions 
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may  be  enforced  at  the  value  employed  in  the  linearization  of  the  projective 
relations  by  simply  deleting  the  rows  and  columns  of  the  normal  equations 
corresponding  to  the  porometen.  This  is  equivalent  to  the  operation  of  letting 

•  ee 

the  a  priori  weight  (in  the  W  or  W  matrix)  of  the  pcrometer  approach  infinity. 
By  so  doing  one  forces  the  solution  for  the  given  parameter  to  assume  the  value 
of  zero/  which,  when  substituted  in  the  remoining  equations,  eliminates  the 
parameter  from  the  overall  system. 

The  lower  right  hand  portion  of  the  normal  equations  consists  of  n 
diagonally  orranged  3x3  blocks  of  elements,  each  such  block  corresponding 
to  the  coordinates  of  a  particular  control  point.  B,  making  the  appropriate 

ee 

diagonal  element  of  the  W  motrix  for  a  given  point  sufficiently  large,  one 
can  force  the  adjustment  to  reproduce  a  pre-established  value  of  any  coor¬ 
dinate  of  the  point  to  within  any  desired  tolerance.  One  could,  of  course, 
rigidly  enforce  a  given  control  point  by  striking  out  the  rows  and  columns  of 
the  normal  equations  corresponding  to  the  point.  Again,  this  would  be  tanta¬ 
mount  to  giving  the  point  infinite  weight. 


1.12  THE  REDUCED  NORMAL  EQUATIONS 

When  the  number  of  unknown  t  lements  of  orientation  is  not  exces¬ 
sively  large,  it  becomes  practical  to  reduce  the  general  normal  equations 
(91)  to  a  system  of  lower  order  by  a  process  of  inversion  of  o  partitioned  system. 
The  practicobility  of  this  approoch  depends  on  the  fact  that,  by  virtue  of  diag- 
onality,  the  inversion  of  the  lower  right  hand  matrix  of  the  normal  equations 

•e  ee  te  ee 

(N+W)  consists  merely  of  the  inversion  of  n  Individual  3x3  matrices  (the  N^+W^) 
and,  hence,  can  be  accomplished  no  matter  how  great  the  number  of  control 
points.  As  shown  in  our  earlier  paper  (Brown,  1958o),  inversion  by  partitioning 

e  ee 

leads  to  the  following  expressions  for  6  and  6: 
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(93)  6 


=  M(c  -  Wf)  +  M(c  -  Wc) 


i-.T 


•  •  •  •• 


(94)  6  =  M  (c  -  We)  +  M(c  -  Wc) 


in  which 


•  •  •  •  •  • 


1^1 

(95)  M  =  1  N  +  W  -  N(N  +  W)“  n'  )■ 


(96)  M  =  (N+W)‘^  +  (N+W)‘^  M  N  (NH-W)"’ 


(97)  M  =  -MN(N  +  W)‘V 


If  we  set 


•  •  «• 


(98)  Q  =  (N  +  W)"^ 


and  note  that  M  in  (97)  then  can  be  written 


(99)  M  =  -  M  , 


the  expression  (93)  for  6  may  be  put  into  the  form 


•  • 


(100)  6  =  M  I  c  -  W€-  Q^(c  -  Wc))  . 


We  shall  refer  to(100)as  the  reduced  system  of  normal  equations.  A  more 

convenient  alternative  expression  for  6  con  be  derived  from  (94)  by  first 

•  • 

using  (98)  to  express  M  in  (96)  as 


•  •  •  • 


(101)  M  =  (N+ W)’^  +  Q  M 
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and  then  substituting  this  together  with  (99)  into  (94),  getting,  upon  collecting 
terms 

(102)  8  =  (N  +  W)"  (c-Wc)  -  QM[  c- Wc- Q'(c-We)] 

in  which,  by  virtue  of  (100), the  postmultiplier  of  Q  in  the  second  term  may  be 

•  •• 

replaced  by  8,  thus  reducing  the  expression  for  8  to  simply 

••  ••••!••  ••••  • 

(103)  8  =  (N  +  W)"  (c-Wc)  -  Q8  . 


This  expression  for  8  differs  from  that  in  our  eorlier  paper  (Brown,  1958a)  in  that 
the  approximations  for  control  are  not  required  necessarily  to  be  precomputed  in 
a  manner  forcing  c  -  Wc  to  zero. 


The  portitioning  employed  in  the  formation  of  the  normal  equations  con 
be  exploited  to  derive  a  convenient  cumulative  process  for  forming  the  reduced 
normal  equations(IOO).  From  the  data  generated  by  the  control  point,  one 
would  compute  the  intermediate  matrices 


(104) 

=  (N 

/W,) 

(105) 

• 

(106) 

• 

^  •  • 

(107) 

As  Sj  and  c^  are  formed  they  are  cumulatively  added  to  their  predecessors 
yielding,  after  the  final  control  point  has  thus  been  processed, 
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(108)  S  =  S, +  $2+  ...  +S„ 

(109)  c  c,  +  C2  +  ...  +  c„ 

In  terms  of  these  the  solution  for  8  becomes 

(110)  6  =  (S+ 'yv)"’(Z- Wc;  . 

e 

Once  8  has  thus  been  determined,  the  solution  for  each  control  point  can  be 

computed  in  turn  from 

(IT)  *6j  =  (Nj+ W^)  -Qj8  , 

which  is  a  direct  consequence  of  the  partitioning  of  (103). 

The  reduction  bosed  on  equations(104)through(11 1)has  a  number  of 

attractive  properties; 

(a)  the  order  of  the  largest  matrix  to  be  formed,  inverted  or  otherwise 
operated  on,  is  equal  to  the  total  number  of  unknown  elements  of 
orientation  and  is  completely  unaffected  by  the  number  of  control 
points  involved  in  the  reduction; 

(b)  the  computations  are  so  arranged  that  data  arising  from  a  given 
control  point  are  processed  independently  of  the  data  from  any 
other  control  point  up  to  the  stage  of  the  cumulative  formation 
of  the  reduced  normal  equations  (this  means  that  the  internal 
storage  required  of  the  computer  depends  almost  exclusively  on 
m  and  is  'ssentiaMy  independent  of  n); 
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(c)  for  n  »  m  the  total  number  of  computations  is  essentially  propor¬ 
tional  to  m^n  rather  than  to  n?  os  would  have  been  the  case  hod 
the  coefficient  motrix  of  the  norrtfoi  equations  been  completely 
filled  with  nonzero  elements. 


1.13  THE  PROCESS  OF  ITERATION 


Before  the  final  residuals  are  computed,  it  may  be  necessary  to  iterate 
the  adjustment  a  number  of  times  in  order  to  reduce  the  effects  of  higher  order 
terms  to  insignificance.  For  this  reoson  we  rewrite  equations (1 10)and  (1 1  i)to 
reflect  the  solutions  resulting  from  the  iteration  of  the  adjustment: 


(112)  *6^‘^ 


/ 


(113) 


6<"  =  (nS" 


The  Initial  solution  corresponds  to  the  case  i  =  0,  and  each  subsequent  solution 
results  from  the  rel i near izat ion  o^  the  original  observational  equations  about  the 
values  resulting  from  the  preceding  solution.  The  process  of  iteration  should  be 
continued  until  a  sufficiently  stable  solution  is  obtained. 

Inasmuch  as  initial  approximations  are  essentially  arbitrary,  nothing  would 
have  prevented  us  from  letting  the  a  priori  observations  of  elements  of  orientation 
and  coordinates  of  control  serve  as  initial  approximations  for  the  linearization  of 
the  observational  equations.  By  thus  setting 
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ofi 

= 

X* 

1 

1 

1 

1  ' 

= 

J 

Y«  = 

1 

1 

1 

J  ' 

• 

• 

• 

z«  . 

Z® 

1  • 

(z")“=  ay 


. (o )  /O ) 

we  would  have  reduced  the  initial  discrepancy  vectors  c'  'and  "c  to  zero  vectors. 
As  a  result,  the  discrepancy  vector*  to  be  used  for  the  first  iteration  of  the  adjustment 
would  have  become 


(115) 

yd)  ,  y(o)^  *5(0) 


/ 


and  in  general 


(116) 


VC)  .  •;(■-!), 5C-1)  .  . 


We  see  then  that,  although  initial  discrepancy  vectors  for  e  and  €  can  be  mode 

equal  to  zero  by  the  natural  and  perfectly  valid  equating  of  initial  approximations 

and  a  priori  observations,  this  does  not  mean  that  subsequent  discrepancy  vectors 
•  •• 

€  and  €  arising  from  the  process  of  iteration  ore  equal  to  zero.  Indeed  as  (115) 

•  •• 

shows,  discrepancy  vectors  for  €  and  c  subsequent  to  zero  initial  vectors  are  r>o 
longer  arbitrary,  but  are  equal  to  the  sum  of  all  preettding  adjustments  of  this 

parometers.  It  is  becouse  this  fact  could  have  been  so  easily  overlooked  thot  we 

•  •• 

chose  to  give  prominence  to  the  vectors  c  and  f  by  avoiding  the  natural  choice 

•  •• 

for  initial  approximations  which  would  have  rendered  €  and  ^  equal  to  zero. 
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1.14  ERROR  PROPAGATION 


After  the  final  iteration  of  the  solution,  equations  (26),  (34),  and  (40) 
can  be  solved  for  the  final  vectors  of  residuols,  giving 

•  •  •  •  «  • 

V  =  €  -  B6  -  B6 

(117)  V  =  €-6  , 

••  ••  •• 

V  =  €  -  6  . 

•  •  • 

If  the  process  of  iteration  were  carried  to  the  point  where  the  final  vectors  6,  6 
were  reduced  to  insignificance,  equations  (117)  would  reduce  to 

V  =  €  , 

•  • 

(118)  V  =  €  , 

•  •  •• 

V  =  €  , 

in  which  the  discrepancy  vectors  are  those  resulting  from  the  substitution  of  the 
final  parameters  into  the  original  observational  equations. 

The  quadratic  form  of  the  residuals  arising  from  the  adjustment  is 


(119)  $  =  v^Wv 


Y  ey  •  •  **T  **  ** 

V  Wv  +  v  Wv  +  V  Wv 


The  degree;  of  freedom  associated  with  the  quadratic  form  is  equal  to  the 
number  of  cbservations  in  excess  of  the  minimum  required  for  a  unique  solution. 
In  the  case  vhere  all  control  points  were  to  appear  on  all  plates  and  where 
a  priori  values  were  available  for  all  elements  of  orientation,  the  total  number 
of  observations  no  would  be  equal  to  2mn+9nT+3n  and  the  degrees  of  freedom 
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k 


would  become  f  =  no  -(9m+3n)  =2mn.  In  most  coses  of  interest,  however,  only 
a  relatively  few  of  the  total  number  of  control  points  will  appear  on  a  given  plate. 
This  situation  is  readily  handled  by  assigning  dummy  observations  having  zero 
weights  to  those  control  points  not  appearing  on  a  given  plate.  In  this  manner 
the  theory  can  be  mode  to  held  for  any  observational  situation  and  total  number 
of  observations  no  becomes  equal  to  the  number  of  nonzero  diagonal  elements  in 
the  composite  weight  matrix  W.  With  no  thus  reckoned,  the  degrees  of  freedom 
for  the  adjustment  becomes,  in  general, 

(120)  f  =  no  -  (9m  +  3n). 

A 

If  a  total  of  m  of  the  9m  elements  of  orientation  were  rigidly  enforced  (thereby 
reducing  the  order  of  the  normal  equations),  the  term  9m  in  (120)  should  be  re¬ 
placed  by  9nr>-m.  Similarly,  if  n  of  the  3n  coordinates  of  control  actually  were 
ta  consist  of  relative  control  for  which  the  assigned  variances  of  the  approximations 

A 

were  grossly  relaxed,  the  term  3n  in  (120)  should  be  replaced  by  3n-n.  On  the 
other  hand,  if  the  assigned  variances  of  the  approximatiotts  employed  for  relative 
control  were  considered  to  be  fairly  realistic,  the  term  3n  would  be  better  left 
unaltered. 


If  the  observational  vector  has  the  multivariate  normal  distribution,  the 

statistic 

(121)  Xi  =  » 

will  have  the  chi  square  distribution  with  f  degrees  of  freedom.  This  may  be 
exploited  in  statistical  testing  of  the  adequacy  of  the  adjustment.  The  estimate 
of  unit  variance  arising  from  the  adjustment  is  given  by 


(122)  0^  =  i/f  . 
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Ideally/  cr^  should  be  equal  ro  unity.  From  the  chi  square  test  one  con  determine 
whether  or  not  the  departure  of  from  unity  is  statistically  significants 

Ti>e  covariance  matrix  of  the  adjusted  porameters  is  provided  by  the 
inverse  cf  i^he  coefficient  matrix  of  the  normol  equations.  In  particular,  the 
covariance  matrix  of  the  adjusted  elements  of  orientation  is 

(123)  2  =  (S+W)"’  =  M 

ond  that  of  the  adjusted  vector  of  coordinates  of  control  is 

••  e«  ••  ••  I  •  Y 

(124)  j  =  M  =  (N  +  W)"  +  Q  M  Q  . 

•• 

The  submatrix  of  D  corresponding  to  the  i  control  point  con  be  shown  to  be 

(125)  =  (N^+  )"’  +  Mq[  . 

•  •  ••  ^ 

The  first  term  of  this  equation  (N^  +  )  represents  the  covorionce  motrix  of  the 

adjusted  coordinates  of  control  under  the  ossumption  thot  tne  elements  of  orientotior 

•  T 

ore  error  free.  The  second  term  represents  the  contribution  to  the 

error  in  triangulation  of  errors  remaining  In  the  odjusted  elements  of  orientation. 
With  a  sufficiently  strong  photogrammetric  net,  one  could  hope  to  suppress  the 
contribution  of  the  second  term  to  insignificance  relative  to  the  first.  This  Is 
generally  the  case  with  a  ballistic  camera  net  where  abundant  stellar  control 
can  be  exploited  to  reduce  the  errors  in  the  calibrated  elements  of  orientation  to 
insignificance.  On  the  other  hand,  with  aerial  photography  the  effects  of  residual 
error  in  adjusted  elements  of  orientation  are  difficult  to  suppress  sufficiently  when 
absolute  control  is  minimal. 


:.15  COMPARISON  WITH  OTHER  THEORIES 


An  alternative  treatnoent  of  the  problem  of  adjusting  the  observed  coor¬ 
dinates  of  control  points  merits  cons i derat f on.  Let  us  first  rewrite  the  observa¬ 
tional  equations  arising  f'om  the  projective  equations  and  from  the  coordinates 
of  control .  These  are 


(126) 


V  + 

e  e 

V  - 


B5  +  B6 


8 


€  , 


€  . 


As  discuued  eorlier/  we  ere  at  perfect  liberty  to  choose  the  approximations 
for  the  coordinates  of  control  to  be  equal  to  their  observed  values/  thereby 

ee 

rendering  €-  0,  Assuming  this  to  be  done/  we  may  write  v  ■  6  and  then  elim- 

ee 

inate  the  parametric  vector  6  from  the  first  of  the  above  pair  of  equations/  thus 
getting 

ee  ee  e  e 

(127)  v+Bv+B6  =  €. 

We  may  rewrite  this  as 

e  e 

(128)  A  V  +  B  6  =  € 

where  A  and  v  are  now  defined  as 


(129)  A  =  (  I  B  )/  V  = 

(2mn,b)  (2mn,  2mn)(2mn/3n)  (b/1) 


V 

(2mn/l) 


•  9 

V 


(3n/l) 


where  b  =  2mn  +  3n,  By  virtue  of  the  eliminotion  of  the  parametric  vector  6  from 
the  linearized  projective  equations/  we  have  reduced  the  number  of  unknown  param- 


* 
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eters  and/  hence,  the  arder  af  the  general  normal  equatiore  from  9n  +  3n  to 
simply  9m.  The  normal  equations  for  the  present  approach  ore 


(130)  (B^  (A  A  A^)"’  B)  6  =  B^  (A  A  aV’  € 

where  "A  is  now  defined  as 

“1 

A  0  I 

(131)  A  =  (2mn/2mn) 

(b,b)  0  A  J 

(3n..3n) 

The  formation  of  the  normal  equations  is  thus  seen  to  entail  the  formation  and 
inversion  of  the  intermediate  matrix 

(132)  G  =  A  A  A^ 

(2mn/2mn)  (2mn/b)(b/b)(b/2mn) 


•  • 

From  the  partitioning  of  B  and  A  indicated  in  (27)  and  (36)  we  may  write 
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which  reduces  to 


ee  ee  e*v 

(135)  SAB 


Bi  Ai  Bi 


0  B2  A2  B2  •  •  • 


0 

0 


#•  ee 

BAB 

n  n  n 


This  is  a  diagonal  matrix  of  r  matrices  of  dimension  2m  by  2m.  inasmuch  os  A 
is  a  diagonal  matrix  of  mn  motrices  of  dimension  2x2,  it  follows  that  the  required 
inversion  of  G  breaks  down  to  the  inversion  of  n  individual  matrices  of  dimension 
2m  X  2m.  On  the  other  hand,  in  the  approach  we  developed  in  Subsection  1.12 
the  reduction  of  the  normal  equations  to  an  equivalent  9m  x  9m  system  was  accom¬ 


plished  through  the  inversion  of  n  intermediate  matrices  of  order  3x3  (the  ), 

It  follows  that  the  approoch  of  the  present  section,  though  mathemotically  equlva* 
lent  to  thot  developed  earlier,  entails  grossly  more  computation  for  lorge  m;  in 
fact,  only  in  the  case  of  the  single  photo  (m=1)  does  the  present  approach  entail 
less  computation  (for  this  case  it  provides  a  practicol  solution  to  the  problem  of 
photogrammetric  rejection  of  a  single  comero  when  the  given  control  is  subject 
to  significant  error). 


Schmid  (1959)  published  a  solution  similar  in  many  respects  to  that  of  Brown 
(1958a).  One  major  difference  is  in  Schmid*  s  treatment  of  errors  in  control  points. 
For  the  general  case  in  which  all  n  poiits  appear  on  all  m  photos,  Schmid  employs 
an  approoch  wherein  the  coordinates  of  each  ground  control  point  are  adjusted  inde¬ 
pendently  for  each  phatograph.  Within  the  framework  of  the  present  subsection,  we 
can  reconstruct  the  essentials  of  Schmid*  s  K»lution  as  follows.  The  typicol  2mx  2m 
submatrix  B^  A^  B^^  appearing  in  (135)  may,  by  the  partitioning  of  (24),  be  ex¬ 
panded  to 
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(136)  BjAj8;  = 


Blj 

•# 


••  **T  **  T 

A,l«ll  bJj-C 


(t37)  B,A,b; 


•  •  ••  ••y  ••  ••  ••  Y 

B|j  AjBjj  B;j  A^  Bjj  ... 


««  ••  ••  y  ••  ••  ••  Y 

BijAjBij  BjjAjBjj  ... 


•  •  •• 

A,  il 


•  •  •• 


b2iA,b; 


mj 


••  •• 

BmJ  Aj  Bmj 


This  is  a  filled  nixm  matrix  of  matrices  or  dimensions  2x2.  In  Schmid's  treatment 
only  the  diogonol  elements  of  above  motrix  ere  actually  formed.  This  is  equivalent 
to  setting 


(138)  B^j  A^  Bj^  =  0  for  all  k  i  . 

In  this  manner,  the  matrices  B  A  bJ  in  (137)  ore  all  reduced  to  diagonal 

i  f  M  ee  ee  e»y 

matrices  of  m  2x  2  matrices  and  this  in  turn  reduces  BAB  (and,  hence,  also 
which,  in  Schmid' s  solutiori,  is  termed  A  f  ^  A^)  to  a  diagonal  matrix 
of  mn  2x  2  matrices.  Thus  the  inventon  of  A  A  A^  becomes  the  equivalent  of 
the  simple  inversion  of  mn  2x  2  matrices  in  place  of  the  far  more  formidable  inver¬ 
sion  of  n  2mx  2m  matrices  as  in  the  rigorous  development. 
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The  irteci  or  unlorlrinn  th»  BAB  mctflzsi  by  the  crbiiro."  impoiirion 
of  (138)  can  be  theoretically  justified  only  if  the  coordinates  of  the  control  points 
were  somehow  to  shift  randomly  about  their  true  positions  from  one  exposure  to  the 
next.  Inasmuch  as  the  world  is  not  made  of  jelly/  such  an  approach  is  unsound  in 
our  opinion.  Moreover,  because  the  coordinates  of  a  given  absolute  control  point 
ore  free  to  shift  independently  for  each  plate,  they  will  tend  to  compensate  unduly 
for  errors  in  the  measured  plate  coordinates  and  will,  thus,  lead  to  attractively  small, 
but  spurious,  plate  residuals.  This  consequence  may  also  be  viewed  as  stemming  from 
the  fact  that  the  degrees  of  freedom  for  the  adjustment  are,  in  effect,  grossly  increased 

A 

from  the  correct  value  of  f  =  2mn  m  -  9m  (for  the  case  where  all  control  is  considered 
to  be  subject  to  adjustment  and  oppears  on  all  photos)  to  f  =  2mn  +  3mn  +  m  -  9m  -  3n. 


Schmid  (1959,  p.  38)  discusses  the  possibility  of  modifying  the  adjustment 
so  that  control  points  subject  to  error  are  adjusted  only  once  within  a  given  photo- 
grommetric  net,  but,  instead  of  developing  the  approach  fully,  he  advocates  (be* 
cause  of  computational  difficulties)  an  alternative  two  step  approach  in  which 

(1)  the  adjustment  is  performed  first  with  all  absolute 
control  treated  as  purely  relative  control  except 

for  the  minimum  control  needed  for  o  unique  solution 
(this  leads  to  a  photogrammetric  model  that  is  approx¬ 
imately  correctly  translated,  rotated  and  scaled); 

(2)  ^dinates  of  the  resulting  model  are  subsequently 
further  refined  by  means  of  a  seven  parameter  transforma¬ 
tion  (three  translations,  three  rotations,  and  change  of 
scale)  determined  in  a  secohd  adjustment  by  the  minimi¬ 
zation  of  the  sum  of  the  squaro>  of  she  residual  distances 
between  the  model  coordinates  and  the  known  coordinates 
of  the  withheld  absolute  control. 
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Schmid  Hjggests  that  the  above  means  of  circumveniing  the  computational  diffi¬ 
culties  inherent  in  the  strictly  correct  adjustment  of  control  subject  to  error  is 
"from  the  theoretical  standpoint  sufficiently  rigorous."  Our  results  and  experi¬ 
ence  would  seem  to  contradict  this.  If/  for  example/  one  were  to  withhold  all 
but  minimal  control  from  the  adjustment  of  a  long  strip  that  is  offected  only  by 
random  errors  of  measurement/  the  typical  result  would  be  a  sinuous  deformation 
of  the  model  because  af  unfavorable  propagation  of  random  error  (systematic  error 
would  contribute  a  secular  component  to  such  deformation).  When  only  minimal 
absolute  control  is  exercised  in  the  simultaneous  adjustment  of  all  photos  in  tlie 
strip/  the  build-up  of  quasi-systematic  deformation  is  not  prevented/  although 
the  degree  of  such  deformation  is  not  as  severe  as  in  the  cose  of  o  photo-by¬ 
photo  cantilever  extension.  With  a  sufficiently  long  strip/  the  overall  defor¬ 
mation  is  characterized  by  several  slowly  changing  cycles  of  positive  and  neg¬ 
ative  departure.  It  follows  that  when  the  model  is  subjected  to  a  rigid  trans¬ 
formation  (three  translations  and  three  rotations)  coupled  with  o  uniform  stretch/ 
only  a  small  part  of  the  total  deformation  will  be  removed/  for  such  a  transfor¬ 
mation  can  accommodate/  at  best/  only  one-half  cycle  of  quasi -systematic 
error  over  the  length  of  the  strip.  The  end  results  of  such  on  approach  will 
ordinarily  bear  little  resemblance  to  the  results  one  would  obtain  from  exer¬ 
cising  all  available  control  in  the  original  adjustment  of  the  strip.  The  effect 
of  utilizing  control  in  this  manner  is  to  'pinch'  the  build-up  of  quosi-systemotic 
error  to  zero  (very  neorly)  in  the  vicinity  of  eoch  absolute  control  paint.  Far 
the  limiting  case  of  absolute  control  of  unrestricted  abundance/  one  can  suppress 
the  build-up  of  quasi-systematic  error  to  complete  insignificance/  provided  the 
control  is  actually  exercised  in  the  phatogrommetric  odjustment.  On  the  other 
hand/  if  it  is  for  the  most  part  withheld,  as  suggested  by  Schmid,  such  control 
can  da  nothing  to  squelch  the  inevitable  build-up  of  significant,  sequentially 
correlated  deformation  of  low  spotiol  frequency. 
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A'Ide  from  uiiimutc  ccr.::dsret!o'’$  accuracy,  there  is  another  cogent 
reason  why  available  absolute  control  should  be  exercised  in  the  adjustment 
rather  than  being  withheld  for  subsequent  determination  of  a  '  corrective'  trans¬ 
formation  of  one  kind  or  another  (e.g<,  the  rigid  transformation  advocated  by 
Schmid  or  more  complex  polynomial  transformotions  advocated  by  Schut  (1964), 
Harris,  Tewinkel,  Whitten  (1962),  and  others).  As  will  presently  be  demon¬ 
strated,  we  have  found  that  the  rate  of  convergence  of  the  recommended  iter¬ 
ative  solution  of  the  normal  equations  is  accelerated  by  the  introduction  of 
absolute  control.  Once  a  certain  critical  level  of  control  is  attained,  conver¬ 
gence  can  be  speeded  by  as  much  as  an  order  of  magnitude.  For  a  long  strip, 
the  critical  level  appears,  on  the  average,  *0  be  a  pair  of  fresh  absolute  control 
points  per  four  ta  five  photos. 

As  we  demonstrated  in  Subsections  1.06  and  1.11,  the  rigorous  adjustment 
of  absolute  control  subject  to  significant  errar  is  computationally  very  simple  within 
the  framework  af  the  concept  of  the  ellipsoidal  control  point,  for  such  control  can 
oe  treated  precisely  in  the  same  manner  as  relative  control,  the  only  distinction 
being  in  the  lower  magnitudes  of  the  elements  of  the  covariance  matrices  (the 
of  the  absolute  control.  In  V'iew  of  this  and  in  view  of  the  foregoing  discuttion, 
we  most  strongly  advocate  that  the  entire  store  of  available  observationol  material 
be  utilized  in  the  simultaneous  adjustment  of  a  photogrommetric  net.  The  general 
theory  developed  in  this  paper  is  sufficiently  comprehensive  to  accommodate  vir¬ 
tually  any  conceivable  type  of  information  that  might  be  applicable  to  the  pKoto- 
grammetric  problem. 

Before  we  leave  this  subsection  to  take  up  the  problem  of  the  solution  of  the 
normal  equatians  for  large  photogrammetri c  nets,  it  is  appropriate  to  review  the  few 
remaining  differences  of  consequence  between  the  writdr' s  earlier  solui’on  (Brown, 
1958o,  1958b,  1959)  and  that  of  Schmid  (1959).  For  the  introduction  of  portiol 
obsalute  control  expressed  in  terms  of  latitude  0,  longitude  X,  and  Iteigit  h,  Schmid 
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•mploys  on  approach  similar  to  that  of  Dodge  (1959).  A  partial  control  point  given 
by  h,  for  instance/  is  considered  to  define  a  spherwido!  sorfccc  on  which  the  roy« 
ore  forced  to  ir;tersect  through  the  introduction  of  the  appropriate  observational 
equotion.  By  the  some  token,  oppropriate  observational  equations  defining  specific 
cones  and  planes  ore  imposed  for  partiol  control  given  in  terms  of  0  and  X.  In  the 
approach  of  Brown  (1959),  partial  control  expressed  in  terms  of  0,  X  and/or  h  is 
treated  os  in  Subsection  1.06  of  the  present  report  (in  the  earlier  report,  the  termirv- 
ology  'relaxation  of  quasi-observati<3nal  variances'  was  employed  in  place  of  the 
'ellipsoidal  control  point'  of  the  present  report).  Here,  instead  of  forcing  rays  to 
intersect  on  various  mathematical  surfaces  (or  intersection  thereof),  one  constrains 
the  rays  to  intersect  as  closely  os  possible  to  the  center  of  on  oppropriotely  defined 
ellipsoid  of  probability.  By  virtue  of  this  concept,  all  essential  distinction  between 
various  types  of  control  points  is  erased;  all  possibilities  are  embraced  by  the  ellip¬ 
soidal  control  point. 

The  extended  solution  outlined  in  Brown  (1959)  provided  the  first  (  and,  to 
this  point,  the  only  )  treatment  of  the  problem  of  adjustin  g  any  of  the  elements  of 
orientation  considered  to  be  observed  quantities  subject  to  random  errors.  This 
opened  up  the  possibility  of  the  rigorous  incorporotion  of  auxiliory  data  gathered 

by  thoce  external  sensors  which  could  be  considered  to  be  sensibly  unbiased  (infor- 

•  • 

motion  from  unbiased  seruors  can  be  fully  absorbed  by  the  matrices  W  and  €),  The 
primory  theoretical  innovation  of  the  present  report  is  the  extension  of  the  solution 
to  apply  to  auxiliary  sensors  whose  observations  may  be  biased  to  a  significant  degree. 
The  primary  practical  innovation  is  the  demonstration  of  the  feasibility  of  certain  of 
the  iterative  procedures  for  the  solution  of  the  enormous  systems  of  normal  equations 
gerserated  by  lorge.  photogrommetric  nets. 

Aside  from  the  differences  outlined  above  between  the  solutions  of  Schmid 
(195^0  ar»d  of  Brown  (1958a,  1959),  there  ore  virtually  no  further  differences  of 
consequence  between  the  two  insofar  as  the  fundamental  photogrammetric  adjustment 


is  concerned.  In  our  comparative  analysis  we  hav'e  concentrated  mainly  on  Schmid's 
theory  because/  in  our  view,  it  is,  in  spite  of  a  few  lapses  in  rigor,  the  only  compet¬ 
ing  theory  which  aspires  to  the  simultaneous  odjustment  a  general  plotogrammetric 
net  with  comparable  theoretical  and  statistical  soundness.  Also,  the  precise  relation¬ 
ship  between  the  two  theories  has  not,  we  feel,  generally  been  apprecioted  by  the 
photogrammetric  community, 


1.16  THE  PROBLEM  OF  ADJUSTING  LARGE  BLOCKS  OF  AERIAL  PHOTOGRAPHY 

The  reduction  of  the  normal  equations  developed  in  Subsection  1.12  has  proven 
effective  in  geodetic  applications  and  in  applicotions  ta  small  ta  medium  blocks  of  aer¬ 
ial  photography  (on  the  order  of  20  ta  30  photos).  However,  problems  of  rounding  error 
and  computing  time  ultimately  render  this  approach  impractical  far  relatively  large  blocks 
(on  the  order  of  40  photos  or  more).  This  means  that,  if  large  blacks  of  photography  ore 
to  be  successfully  adjusted  as  organic  units,  an  effective  alternative  to  the  reduction  of 
the  normal  equations  must  be  developed.  The  development  of  such  an  alternotive  is  ac¬ 
tually  the  primary  objective  of  this  investigation.  Toward  this  end,  we  have  concentrated 
mainly  onthc  problem  of  adjusting  Sorge  blocks  of  aerial  photography  having  fairly  con- 
si  sttt  patterns  of  forward  and  side  overlap.  Our  original  approach  was  based  on  the  fal¬ 
lowing  consideratiorts: 

(1)  the  coefficient  matrix  of  the  general  normal  equations  for  an  aerial  black 
is  both  highly  patterned  and  highly  sparse  (i.e.,  consists  predominantly 
of  zero  elements); 

(2)  by  means  af  an  appropriate  indexing  algorithm,  it  is  possible  ta  collapse 
the  full  coefficient  matrix  of  the  normal  equations  ta  a  for  more  campoct 
matrix  containing  few  zero  elements; 

(3)  this  ‘  collapsed  system'  of  normal  equations  con  be  computed  directly, 
thus  by-passing  the  unnecessary  computation  of  zero  elements; 
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(4)  a  computing  algorithm  con  be  formulated  to  exploit  the  collapsed 
system  of  normal  equations  to  effect,  if  practical,  the  solution  by 
means  of  recently  developed  iterative  procedures  which  are  vast 
improvements  on  the  classical  Gauss-Seidel  method; 

(5)  the  computing  algorithm  con  be  designed  to  operate  on  natural  blocks 
of  elements  of  the  normal  equations,  rather  than  on  a  single  row  at 

a  time; 

(6)  through  a  process  called  "intertwining,"  it  is  possible  to  rearrange 
the  coefficient  matrix  of  the  general  normal  equations  in  such  a  man¬ 
ner  as  ta  achieve  a  highly  diagonal  form  which  could  conceivably  be 
conducive  to  the  more  rapid  convergence  of  the  iterative  process. 

The  rationale  of  our  approach  is  perhaps  best  presented  in  terms  of  concrete 
examples.  Let  us  begin  with  consideration  of  the  form  of  the  general  normal  equations 
arising  from  what  we  shall  term  a  ‘  uniform  block.'  A  uniform  photogrammetric  block 
is  one  which  has  a  consistent,  self-reprodu^-ing  pattern  of  control  and  overlap.  A 
specific  illustration  of  a  uniform  block  four  photos  wide  and  five  photos  long  is  presented 
in  Figure  1.1.  Each  photo  in  the  block  has  a  consistent  nine  point  pattern  of  control 
(we  use  the  term  ‘  control'  here  in  the  brood  sense  to  denote  anything  from  a  relative 
control  point  (pass  point)  to  on  absolute  control  point;  all  ore  ellipsoidal  control  points). 
The  forwar  J  overlap  is  sixty  per  cent  and  side  overlap  is  twenty  per  cent.  Except  where 
boundary  conditions  prevail,  each  triple  overlap  area  ond  each  sextiple  overlap  area 
contoins  one  and  only  one  control  point.  In  practice,  of  course,  it  is  most  unlikely 
that  one  will  obtain  blocks  of  photography  displaying  such  uniform  characteristics  of 
overlap.  On  the  contrary,  it  is  not  unusual  for  there  to  be  gaps  in  the  side  overlap 
and  for  there  to  be  different  numbers  o*  photos  in  contiguous  strips,  thus  rendering  the 
strips  '  out  of  phase'  insofar  as  the  uniform  block  is  concerned.  In  some  instances, 
such  difficulties  could  be  rectified  by  the  twofold  expedients  of  (a)  inserting  dummy 
observations  hoving  zero  weight  matrices,  (b)  inserting  both  dummy  observations  having 
zero  weight  matrices  and  appropriate  dummy  photos  having  nonzero  weight  matrices. 
Thus,  for  example,  if  a  control  point  for  a  certain  position  were  to  be  missing  on  one 


or  more  photot  (os  might  easily  happen  if  sidelop  were  to  foil  outside  of  tolerance)/ 
orte  could  ouign  dummy  plate  coordinates/  toy  (0/0)/  to  the  missing  image  and  assign 
zero  weights  to  these  plate  coordinates.  By  virtue  of  such  weighting/  the  dummy 
coordinates  will  in  no  way  effect  the  finol  results.  In  a  similar  manner/  complete 
gaps  in  the  photography  or  pitosing  discrepancies  of  strips  con  often  be  rectified 
through  the  ir»sertion  of  dummy  photos  hoving  dummy  images.  To  ovoid  indeterminacy/ 
the  assigned  elements  of  orientation  of  dummy  photos  must  be  given  finite  weights. 

When  introduced  in  this  manner/  dummy  photos  hove  no  effect  on  the  end  results/ 
but  yet  do  contribute  to  the  complete  predictability  of  the  data  flow.  This  is  of  great 
value  in  the  exploratory  formulation  of  simple  indexing  algorithms  for  the  collapsing 
and  subsequent  implicit  reconstruction  of  the  coefficient  motrix  of  the  normal  equotions. 
For  this  reason/  at  the  outset  of  our  investigation  we  confined  our  considerotion  to 
uniform  blocks.  Once  the  effectiveness  of  our  proposed  approach  hod  been  demon¬ 
strated/  we  abandoned  the  stipulotion  thot  a  uniform  block  be  employed  for/  even 
with  the  aid  of  dummy  observations  and  dummy  photos/  the  transformation  of  on  actual 
block  into  o  uniform  block  can  prove  to  be  cumbersome/  except  for  the  case  of  the 
isolated  strip. 

With  the  understanding,  then/  that  our  consideration  of  the  uniform  block 
is  strictly  for  exploratory  purposes/  we  may  proceed  to  investigote  the  character  of 
the  normal  equations  of  the  form  (91)  as  generated  by  the  adjustment  of  the  sample 
block  of  Figure  1.1.  The  form  of  this  coefficient  matrix  is  Indicated  in  Figure  1.2a. 
The  solid  end  shaded  areas  of  the  figure  corresporid  to  nonzero  elements;  all  other 
oreos  are  filled  by  zero  elements.  The  most  striking  choracteri sties  of  the  coefficient 
matrix  are 

(a)  the  regularity  of  the  pottern/ 

(b)  the  predominance  of  zero  elements. 
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flGU«  I  26  COLLAnCO  fO«M  OF  COtffiCIfNT 


The  submatrices  of  the  N  portion  of  th.'  normal  equations  are  nonzero  matrices 
only  when  the  point  appears  on  the  photograph,  in  which  case  the  N  inter- 
locks  the  corresponding  and  portions  of  the  normal  equations.  The  portion 
of  the  matrix  corresponding  to  may  be  described  as  consisting  of  four  '  landings' 
of  'staircase'  matrices  with  three  parallel  staircases  to  a  landir<g.  Each  individual 
staircase  is  generated  by  a  particular  row  of  control  points;  the  longer  the  row  the 
longer  the  staircase.  Each  landing  is  generated  by  a  particular  strip;  the  number  of 
landings  is  equal  to  the  number  of  strips.  The  number  of  staircases  per  landing  is 
equal  to  the  number  of  rows  of  control  points  per  strip.  The  last  staircase  in  each 
landing  lies  directly  over  the  first  staircase  in  the  next  landing.  This  is  a  consequence 
of  the  control  in  the  side  overlap  (were  there  no  contro;  in  the  side  overlap,  the  nor¬ 
mal  equations  for  the  block  would  degenerate  Into  separable  sets  of  independent  nor¬ 
mal  equations  for  strips).  From  the  foregoing  considerations,  it  becomes  a  simple 
matter  to  generalize  the  pattern  of  the  normal  equations  in  Figure  1.2a  to  apply  to 
a  uniform  block  of  any  dimens'ons,  as  long  as  the  basic  nine  point  pattern  of  control 
is  maintained  and  the  numbering  of  photos  and  control  points  corresponds  to  that  of 
Figure  1.1.  For  instance.  If  the  block  were  4x50  instead  of  4x5,  the  staircases 
would  merely  become  lengthened  to  50 steps  instead  of  5  steps,  The  N't  W  portion 
of  the  matrix  would  consist  of  200  diagonally  arranged,  nonoverlapping  6x6  matrices 


*  *  •  • 

instead  of  20,  and  the  N-tW  portion  would  be  increased  from  63  diagonally  arranged, 
nonoverlapping  3x3  matrices  to  378,  In  general,  the  number  of  control  points  In  a 
uniform  b'.'ck  of  the  type  of  Figure  1. 1  is  {2ft1)x(p+2)  where  s  denotes  the  number  of 
strips  and  p  is  the  number  of  photos  per  strip.  If  the  4x50  block  were  now  increased, 
to,  say,  a  10x50,  the  effect  on  the  R  portion  of  the  matrix  would  be  merely  to  In¬ 
crease  the  number  of  staircase  landings  from  4  to  10  with  each  landing  consisting  of 
3  parallel  stoircoses  50  steps  high,  the  first  staircase  in  each  landing  being  directly 

e  «  ee  ee 

below  the  last  staircase  in  the  landing  above.  The  N-tW  and  N  W  matrices  would 
increase  to  500  diogonolly  arranged  6x6  matrices  and  to  1092  diagonally  arranged 
3x3  matrices,  respectively.  The  order  of  the  general  normal  equations  would  thus 
become  6x500  3x1092  =  6276. 
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Ai  a  uniform  block  becomes  larger  and  larger,  the  ratio  of  the  number  of 
nonzero  elements  to  the  total  number  of  elements  in  N  (the  coefficient  matrix) 
decreosei  draiticallv.  For  the  type  of  block  of  Figure  1.1  this  ratio  is 

r.u:'  ber  of  nonzero  elements  in  N  9  (42sp  +  4s  +  p  +  2) 

total  number  of  elements  in  N  9  (4sp  4s  +  p  +  2)^ 


i'A 


for  large  s  and  p. 


Thus,  in  a  4x5  block  about  1  element  in  12  is  nonzero,  in  a  4x50  black  the  ratio 
is  about  1  in  76,  and  In  a  10x50  block  it 's  about  1  in  194,  The  fact  that  the  nor¬ 
mal  equations  are  so  highly  patterned  with  such  a  small  portion  of  the  elements 
,iiig  nonzero  suggests 

(a)  that  the  normal  equations  be  formed  in  such  a  manner  that  only  the 
nonzero  elements  are  actually  generated, 

(b)  that  an  alternative  representation  of  the  normol  equations  be  developed 
to  exploit  to  the  fullest  the  patterned  characteristics  of  t!ie  equations 
and  to  render  the  system  as  compact  as  possible, 

(c)  that  the  solution  of  the  normal  equations  be  effected  by  a  suitable 
iterative  process  designed  to  operate  only  on  the  blocks  of  nonzero 
elements. 

With  regard  to  (a)  there  Is  no  particular  problem.  The  logic  of  generating  only  the 
nonzero  constituei.rs  of  the  normal  equations  is  fairly  simple  and  straightforward.  With 
regard  to  (b)  there  is  again  no  particular  problem,  far  the  coefficient  matrir:  of  the  gen¬ 
eral  normal  equatians  can  be  'callapsed*  to  the  compact  scheme  indicoted  in  Figure  1.2b. 
Here  all  zero  blocks  of  elements  have  been  'squeezed'  out  of  the  original  normal  equo- 
tions  by  sliding  each  nonzera  subrblock  ta  the  left  cs  far  os  possible.  The  solid  blocks 
in  Figure  1.2b  correspond  to  the  diagonal  blocks  of  the  original  normo!  equations.  We 
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see  that  the  collapsed  normal  equations  are  also  highly  patterned.  It  is  clearly  possible 
to  establish  a  set  of  rules  or  algorithms  by  means  of  which  the  elements  of  the  collapsed 
matrix  can  be  related  to  their  counterparts  in  the  original  matrix.  Inasmuch  as  the  col¬ 
lapsed  system  in  conjunction  with  a  small  set  cf  algorithms  is  sufficient  to  reconstruct 
the  original  system,  there  is  really  no  need  to  generate  the  original  system  in  the  first 
place.  It  is  sufficient  to  generate  the  collapsed  system  directly.  Not  only  can  this 
be  done,  but  it  can  be  done  on  a  relatively  small  digital  computer  such  os  the  IBM  1620 
(not  that  we  necessarily  recommend  this).  This  is  true  no  matter  what  the  dimensions  of 
the  block,  for  the  maximum  number  of  columns  in  the  collapsed  system  can  never  exceed 
39  (this  again  assumes  the  9  point  pattern  of  control  of  Figure  1.1).  The  only  effect  of 
increasing  rhe  length  or  width  of  the  block  is  to  lengthen  the  collapsed  matrix  of  nor¬ 
mal  equations;  it  can  never  be  widened.  Thus  the  computer  can  be  programmed  in  such 
a  monner  as  to  generate  the  collapsed  normal  equations  row  by  row  or,  more  naturally, 
horizontal  block  by  horizontal  block.  The  total  computational  time  in  setting  up  the 
collapsed  system  will  thus  increase  only  linearly  with  the  number  of  photos  in  the  block. 
It  is  this  fact  that  makes  the  use  of  a  small  computer  feasible  for  this  stage  of  the  reduc¬ 
tion. 


With  regard  to  point  (c)  above,  it  is  a  relatively  simple  matter  to  set  up  an  iter¬ 
ative  solution  that  will  operate  only  on  the  nonzero  blocks  of  elements.  The  pivotal 
question  is  whether  or  not  a  prohibitive  number  of  iterations  will  be  required  for  adequate 
convergence.  Unfortunately,  this  question  cannot  be  answered  in  advance  on  the  basis 
of  purely  theoretical  considerations.  The  answer  is  to  be  obtained  only  by  actual  trial 
through  numerical  simulation  of  various  typical  operational  situations  of  particular  inter¬ 
est.  The  great  bulk  of  our  effort  in  the  present  investigation  has  been  directed  toward 
this  end.  Details  of  the  numerical  processes  employed  and  of  the  results  obtained  are 
given  in  Section  2.  We  shall  confine  our  attention  In  tbe  remainder  of  this  section  to 
further  development  of  the  general  approach  and  to  a  brief  discussion  of  the  high  points 
of  our  numerical  results. 
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1 . 17  ALTERNATIVE  ARRANGEMENTS  OF  THE  NORMAL  EQUATIONS 


Let  us  toke  the  block  of  Figure  1.1,  but.  Instead  of  numbering  the  photos 
ond  control  points  according  to  rows,  let  us  number  them  accor.iing  to  columns  as 
in  Figure  1.3.  Tfi#  general  normol  equations  then  assume  the  alternative  form  indi¬ 
cated  in  Figure  1.4o,  the  collapsed  form  of  which  is  indicated  in  figure  1.4b.  The 
N  portion  of  this  system  is  somewhat  simpler  than  in  our  earlier  system  of  Figure  1 .2a. 
This  raises  the  question  of  whether  one  arrangement  offers  any  practical  advantage 
over  the  other  with  regard  to  rapidity  o4  convergence  of  the  iterative  process.  It  also 
raises  the  brooder  question  of  the  role  played  by  the  arrangement  of  the  normal  equa¬ 
tions  in  general.  Is  there  some  optimal  arrangement  offering  significant  advantages? 

In  our  further  investigotion  of  arrangements  of  the  normal  equations,  we  were 
able  to  devise  orderings  of  the  unkrK>wns  which  would  confine  all  nonzero  blocks  of 
elements  to  lie  with  a  limited  band  about  the  diagonal.  The  normal  equations  for  one 
such  arrangement  are  indicated  in  Figure  1.5a  and,  in  collapsed  form,  in  Figure  1.5b. 
Here,  the  numbering  of  photos  and  points  is  according  to  columns  as  in  Figure  1.3. 
However,  the  vector  of  unknowns  has  been  rearranged  according  to  the  following 
scheme  in  which  successive  sub-vectors  of  the  solution  vector  are  listed  h.orizontally: 

•  e  •  ••  ••  •  ••  ••  ••  •• 

Sir  Sir  52,  63,  62/  84,  65,  6j,  64,  67,  64,  63,  69 

•  •  •  ••  ••  •  ••  ••  ••••••  ••  •• 

5l0r  85,  811,8)2,84,  613,  8)4,  67,  8)5,  S)4,  6g,  S)7,  6)8 

8)9,  89,  820,  82) ,  8)0,  822,823,  8)),  824,625,8)2,  825,^7 

etc. 

The  control  point  vectors  645  through  643  generated  by  thejast  two  columns  of  control 
terminate  the  sequence  of  unknowns.  This  system  of  normal  equations  may  be  said  to 
be  dominated  by  elements  on  and  near  the  diagonal.  All  nonzero  elements  are  confined 
to  a  diagonal  band  225  elements  in  width;  moreover,  within  this  band  one  can  define 
five  narrower  bands  (each  21  elements  in  width)  which  contain  all  nonzero  elements  ex¬ 
cept  those  generated  by  the  last  two  columns  of  control.  An  attractive  feature  of  this 


1st  column  of  photos 
and  points 

2nd  column  of  photos 
and  points 

3rd  column  of  photos 
and  points 
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Figure  1.3 


Illustrating  Uniform  Block  cf  Dimensions  4x5.  Numbering  of  Control  Points 
and  Photos  is  According  to  Columns.  Strips  ore  Considered  to  Run  Verticclly. 
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arrangement  of  the  normal  equations  is  that  the  width  of  the  diagonal  band  confining 
all  nonzero  elements  is  independent  of  either  the  length  or  the  width  of  the  block  of 
photos.  In  this  tense,  then,  at  the  dimensions  of  the  block  increase,  so  does  the  rel¬ 
ative  diagonality  of  the  normal  equations.  In  the  cate  of  a  10x50  block,  for  instance, 
the  diagonal  bond  containing  all  nonzero  elements  will  comprise  only  about  three  per 
cent  of  the  matrix. 

We  have  employed  the  term  'intertwining*  to  describe  the  process  of  reordering 
the  unknowns  for  the  purpose  of  achieving  relatively  strong  diagonality.  The  guiding 
principle  of  the  process  of  intertwining  is  the  devising  of  an  arrangement  of  the  normal 
equations  such  that  the  coefficients  of  the  unknowns  corresponding  to  a  given  control 
point  are  os  close  in  the  matrix  as  possible  to  those  photos  on  which  the  points  appeor. 

At  the  outset  of  the  investigation  the  writer's  collaborators  devised  two  other 
schemes  of  intertwining  of  greater  compactness  and  efficiency  than  that  of  Figure  1.5a. 
These  are  illustrated  in  Figures  2.21  and  2.22  of  Section  2.  During  the  course  of  the 
investigation  we  learned  that  our  Initial  enthusiasm  for  the  prospective  effectiveness  of 
intertwining  as  a  means  for  accelerating  the  convergence  of  the  iterotive  solution  of  the 
normol  equations  was  unwarranted,  for  the  simpler  and  more  prosaic  orderings  of  Figures 
1 .2  and  1 .4  actually  turned  out  to  be  more  effective  !n  this  regard.  As  we  shall  see  in 
Section  2,  the  failure  of  intertwining  to  live  up  to  expectations,  though  t  blow  to  our 
intuition,  is  hardly  to  be  regarded  as  an  untr>ward  result,  particularly  in  view  of  the 
relative  complexity  of  the  collapsing  algorithms  associated  with  the  process.  Moreover, 
since  future  investigators  may  profit  from  our  negative  finding  by  avoiding  the  duplica¬ 
tion  of  this  particular  ap^proach,  we  feel  our  discussions  of  the  concept  of  intertwining 
are  justified. 
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1.18  CXJTLINE  OF  KEY  RESULTS 


Tlte  results  of  our  initial  four  months  of  effort  ore  summarized  in  cn  interim 
report  (Brown,  Davis,  Johnson,  1963)  which  is  now  superceded  by  this,  the  firwl 
report.  By  a  process  of  numerical  simulation  we  were  able  to  estoblish  in  the  interim 
report  thot  of  the  three  iterative  techniques  investigated 

1.  Gouss-Seidel , 

2.  Gauss-Seidel  with  Luisternik  accelerotion  (Foadevo,  1959), 

3.  Method  of  Successive  Over  Reloxotion  (Varga,  1962), 

the  first  was  far  too  slow  in  converging  to  be  considered  practicol,  and  the  second 
blew  up  numerically.  On  the  other  hand,  the  third  provided  excellent  results, 
converging  to  a  satisfactory  solution  for  o  simuloted  25-photo  strip  in  less  thon  10 
minutes  on  on  IBM  7094. 

One  of  our  most  significant  findings  concerns  the  effect  of  obsolute  control  on  the  rote 
of  convergence  of  the  iterotive  process.  A  strip  hoving  only  the  minimal  obsolute  con¬ 
trol  required  for  determinocy  wos  found  to  converge  appreciably  more  slowly  thon  one 
having  o  moderate  sprinkling  of  control  throughout  the  strip.  With  o  41 -photo  strip 
generating  o  system  of  normal  equations  of  order  633,  for  instance,  odequote  convergence 
wos  obtained  within  150  iterotions  (6  minutes  on  on  IBM  7094)  when  o  pair  of  fresh 
absolute  control  points  was  introduced  on  about  every  fifth  phcto.  On  the  other  hand, 
on  the  order  of  600  iterations  were  required  when  the  same  strip  was  odjusted  with 
absolute  control  limited  to  the  beginning  of  the  strip  (fall  details  ore  given  in  Section 
2).  Our  simulations  to  date  indicate  that  the  number  of  iterations  required  for  satis¬ 
factory  convergence  is  roughly  equol  to  the  order  of  the  norma!  equotlons  for  the  cose 
of  strips  with  minimal  obsolute  control;  for  strips  having  a  moderate  level  of  well- 
distributed  absolute  control,  the  number  of  iterotions  may  be  as  few  as  one  fifth  to 
one  tenth  of  the  order  of  the  normal  equotions.  There  is  even  some  indication  that 
once  0  certain  level  of  obsolute  control  is  ottoined,  the  number  of  iterations  for 
satisfactory  convergence  moy  be  only  very  weekly  dependent  of  the  order  of  the  normal 
equations.  If  farther  investigotion  should  prove  this  to  be  the  cose,  the  distinct 
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possibility  emerges  that  the  simultaneous  adjustment  of  a  long  strip  of  aerial 
photography  may  entail  no  more  than  the  general  order  of  computational  effort  os 
is  required  for  the  reconstruction  of  the  strip  by  means  of  analytic  cantilever  extension 
operating  on  poirs  of  photos. 

Toward  the  end  of  our  study  we  were  successful  in  devising  on  efficient 
collapsing  algorithm  for  the  normal  equotions  generated  by  o  general,  non-uniform 
block  of  photography.  Our  limited  numerical  simulations  with  blocks  lead  us  to 
believe  that,  in  full  scale  practical  application,  the  rigorous  adjustment  of  large 
blocks  of  aerial  photography  will  involve  appreciably  less  computational  effort  than 
the  adjustment  of  long  strips  having  comparable  numbers  of  photos  and  levels  of 
control.  To  appreciate  this,  one  should  view  the  conventional  aerial  block  os  a 
continuous,  folded  strip.  In  such  a  folded  strip,  control  in  the  side-overlap  is 
common  te  subintervals  of  the  strip  and  serves,  therefore,  to  reduce  appreciably 
the  number  of  unknown  control  points.  The  resulring  reduction  of  the  order  of  the 
normal  equations  and  the  bi-directional ity  of  computational  transference  made 
possible  by  side-overlap  constraints  combine  to  accelerate  the  convergence  of  the 
iterative  solution  of  the  normal  equations  of  the  block.  It  Is  this  that  ultimately 
renders  the  block  computationally  more  attractive  than  the  strip,  even  though  the 
logic  of  the  data  handling  for  the  block  is  more  complicated. 

1.19  CONCLUSIONS 

Our  central  goal  of  developing  a  computationolly  feasible  procedure  for 
sol  ving  the  norma!  equations  for  large  photogrammetric  nets  has  been  successfully 
attained.  In  particular,  we  have  removed  the  primory  impediment  to  the  implementation 
of  the  rigorous  adjustment  of  large  blocks  of  aerial  photography.  By  virtue  of  the 
successful  implementation  of  the  concept  of  the  direct  formation  of  the  collapsed 
normal  equations  the  computing  time  required  for  the  formation  of  the  normal 
equations  for  an  aerial  block  becomes  strictly  proportional  to  the  number  of  photos 
in  the  block  rather  then  increasing  as  the  square  of  the  number  of  photos  as  in  previous 
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reductions.  With  sufficiently  large  blocks  having  a  sufficient  level  of  absolute 
control,  there  is  some  evidence  to  suggest  that  the  number  of  iterative  cycles 
required  for  adequate  convergence  of  the  normal  equations  may  level  off  to  an 
almost  stationary  value,  little  affected  by  the  inclusion  of  additional  photos.  If 
this  should  bear  up  under  further  investigation,  it  will  mean  that  not  only  the 
formation  of  the  normal  equations  but  olso  their  solution  will  be  essentially 
proportiorKil  to  the  number  of  photos  in  adequately  controlled  aerial  blocks  of 
sufficient  Size.  We  believe  that  the  simultaneous  adjustment  of  blocks  of  several 
thousand  photoswill  prove  to  be  altogether  feasible  through  the  implementation  of 
optimal  buffering  procedures  wherein  external  storage  (tape,  magnetic  disks,  etc.) 
and  core  storage  are  both  used  to  maximum  advantoge.  In  this  regard,  we  would 
point  out  that  Varga  (1962,  p.  1)  tells  of  a  computer  program  designed  to  accomplish 
the  iterative  solution  of  a  system  of  simultaneous  equations  of  order  108,000  generated 
by  the  numerical  solution  of  a  three  dimensional  system  of  partial  differential 
equations.  In  view  of  this  coupled  with  our  success  in  applying  iisjstive  p-rc-cedure* 
to  the  photogrommetric  problem,  we  feel  that  the  time  is  at  hand  when  the  photo- 
grammetrist  need  no  longer  be  intimidated  by  the  enormous  systems  of  equations  arising 
from  the  uncompromisingly  rigorous  adjustment  of  large  blocks  of  photography. 


Our  numerical  investigations  so  far  have  been  limited  to  the  realm  of  classical 
photogrammetry  where  auxiliary  sensors  play  no  role.  Yet,  with  the  development  of 
such  integrated  mapping  configurations  as  the  Air  Force  USQ-28  system,  it  is  cleor  that 
we  are  at  the  threshold  of  a  new  era  in  photogrammetry  in  which  auxiliary  sensors  will 
become  of  increasing  importance.  Anticipating  this,  we  extended  the  theory  of  the 
general  photogrammetric  adjustment  in  a  nonrestrictive  fashion  to  accommodote  Informa¬ 
tion  from  any  conceivable  combination  of  auxiliary  sensors  with  due  allowance  being 
made  for  the  likelihood  that  the  output  of  many  sudh  seniors  may  be  subject  to  significant 
bias  and  hence  may  have  to  be  calibrated  within  the  framework  of  the  overall  adjustment. 
We  are  of  the  opinion  that  the  role  of  qnalytical  techniques  will  be  increased,  rather  than 
diminished,  by  the  implementation  of  integrated  mapping  systems  exploiting  various 
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arrays  of  ouxiliory  sensors.  Just  os  the  introduction  of  o  certoin  level  of 
obsolute  control  serves  to  accelerate  greatly  the  convergence  of  the  iterotive 
solution  of  the  normal  equotions,  so  too,  we  suspect,  would  the  introduction  of 
constroints  imposed  by  ouxiliory  sensors.  In  our  future  work  we  expect  to  determine 
to  what  extent  this  is  the  case  and  to  concentrote  on  the  potential  contribution 
to  the  photogrammerric  odjustment  of  vorious  combinations  of  existing  ond  proposed 
ouxiliory  sensors. 
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SECTION  2 


NUMERICAL  ANALYSIS  AND  NUMERICAL  RESULTS 

By 

Duane  C .  Brown 
Ronald  G.  Davis 
Frederick  C.  Johnson 


2.01  INTRODUCTION 

The  development  of  the  theory  of  the  general  photogrommetric  adjustment 
and  of  o  speciHc  approach  to  the  solution  of  the  normal  equations  has  been  accomplished 
in  Sectioi>  1  •  Our  objectives  in  this  section  are  to  provide  a  detailed  account  of  the 
steps  taken  i'j  test  and  implement  this  approach  and  to  present  and  ihterpret  results  ob¬ 
tained. 

The  f'^it  part  of  this  section  is  devoted  to  an  expository  treatment  of  iterative 
procedures  for  the  solution  of  simultaneous  linear  equations  with  particular  emphasis 
on  the  Method  of  Successive  Over  Relaxation.  Following  this,  we  describe  the 
successive  stages  of  our  numerical  investigation  beginning  with  the  simulation  of 
the  basic  two  photo  problem  and  proceeding  to  simulated  six  photo  strips,  twenty- 
five  photo  strips  and  forty -x}ne  photo  strips  (the  maximum  that  can  be  handled  in 
core  of  a  32K  IBM  7(K''4).  Each  stage  of  these  strip  simulations  was  designed  to  answer 
certain  specific  questions  and  each  provided  unexpected  insight  into  various  facets  of 
the  general  problem.  From  the  simulation  of  strips,  we  proceeded  to  the  simulation  of 
small  blocks  (3x5  photos)  and  finally  to  the  reduction  of  a  23  photo  strip  of  actual 
photography.  As  we  shall  see,  the  results  of  our  numerical  studies  confirm  the  validity 
of  the  approach  developed  in  Section  1 . 
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2.02  general  background  ON  ITERATIVE  METHODS  OF  SOLVING 


LINEAR  EQUATIONS 

Because  of  the  exceuive  dimensions  of  the  system  of  normal  equations 
generated  by  a  sizeobie  photogrommi*tric  block,  direct  methods  of  solving  rhe 
system  (e.g. ,  Gaussian  elimination  or  one  of  its  many  variants)  are  not  practical . 
Unfortunately,  such  methods  tend  to  collapse  due  to  the  excessive  amount  of 
round-off  error  introduced  into  the  solution  of  large  systems  by  the  required  machine 
calculations. 

To  alleviate  the  undesirable  consequences  arising  from  the  round-off 
error  introduced  by  direct  methods  of  solution,  recourse  may  be  made  to  itera¬ 
tive  methods.  The  advantage  of  such  methods  is  that  the  original  system  of  equa¬ 
tions  or  some  simple  transformation  thereof  remains  unaltered  in  memory  through¬ 
out  all  stages  of  the  calculation  of  the  solution  thus  adding  a  great  stabilizing 
factor  to  the  computational  process. 

The  first  of  the  iterative  procedures  was  developed  by  C  Jucobi  (1845). 

This  method  was  improved  in  1874  to  give  the  Guuss-Seidel  method.  Unfortunately, 
both  of  these  methods  suffer  from  the  fact  that  the  rate  of  convergence  for  large 
systems  of  equations  is  often  very  slow;  thot  is  to  say,  many  thousands  of  iterations 
are  often  needed  for  the  iterative  procedure  to  converge  to  a  good  approximation 
to  the  solution  of  a  sizeable  system  of  equations.  Since  the  required  computations 
were  necessarily  done  by  hand  when  these  methods  were  developed,  they  were 
considered  impractical  and  fell  into  a  state  of  temporary  disuse  except  for  occasional 
applications  to  geodetic  reductions  and  minor  roles  in  other  applied  fields. 

With  the  advent  of  the  modern  electronic  computer,  iterative  methods  were 
again  investigated  os  a  method  of  solving  large  systems  of  linear  equations.  Although 
the  actual  computations  involved  in  the  iterative  process  were  no  longer  formidable. 


the  prohibitively  slow  rote  of  convergence  of  the  Jacobi  and  Gouss-Seidel  methods 
caused  these  procedures  to  be  used  only  on  moderately  large  systems  of  equations 
and  methods  of  Decelerating  the  rote  of  convergence  were  sought.  D.  Young  (1954) 
developed  the  method  of  Successive  Overreloxotlon  (SOR)  which  may  be  viewed  os 
o  powerful  algorithm  for  accelerating  the  rote  of  convergence  of  the  Gouss-Seidel 
method.  With  the  development  of  this  method  and  its  extension  to  the  block  itero- 
tive  technique  (to  be  discussed  shortly)  the  solution  of  lorge  systems  of  linear  equa¬ 
tions  has  become  feasible  for  a  large  class  of  important  problems  including  (as  we 
shall  see)  the  adjustment  of  large  photogrommetric  nets. 

2.03  THEORETICAL  DEVELOPMENT  OF  ITERATIVE  METHODS 

Let  us  consider  a  system  of  n  linear  equations  in  n  unknowns: 

+  0,2X2  +  ...  +  a,nXn  =  b, 

+  022X2  ...  +  a2„x„  ^  bj 


a„  X, 
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then  the  system  (1)  can  be  written  in  matrix  notation  as 

(3)  Ax  =  b  . 

If  we  expreu  the  coefficient  matrix  A  as  the  sum 

(4)  A  =  D  -  E  -  F 

where 
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than  equation  (2)  becomes 


(6)  (D  -  E  -  F)  X  =  b 
which  may  '^e  rewritten  os 

(7)  Dx  =  (E+F)x  +  b. 

From  this  we  may  immediately  write 

(8)  X  =  D"’  (E  +  F)x  +  D"’  b 

provided  none  of  the  a^  ^  are  zero.  If  any  of  the  a^  ^  were  zero^  we  could 
rearrange  the  equations  to  remove  this  difficu  Ity, 

If  v/e  let  be  the  initial  approximation  to  the  solution  x  of  (1),  then 
equcition  (8)  can  be  used  to  define  the  iterative  procedure 

(9)  x^*'*’'  =  D"Ne+ F)  x^*^+  D‘^  b  . 

This  is  the  Jacobi  iterative  method. 


Since  D  is  a  diagonal  matrix,  we  have 
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Accordingly,  if  we  let 


(11)  = 


(0 


^7 


we  can  rewrite  (9)  in  its  computational  form 


(12)  x; 


(k*i) 


'  ^  o,,  x<*>  *  -1 

1  =  ,  "  ’ 


I 

1=1 

1  + 


b,;  1  £i  Sn 


If  equation  (6)  is  rewritten  as 

(13)  (D-£)x  =  Fx  +  b, 
the  immediate  result 

(14)  X  »  (D  -  E)"^  Fx  +  (D  -  E)"’  b 
can  be  used  to  define  the  iterotive  procedure 

(15)  =  (D-E)"’  Fx^^^  +  (D-E)’’  b  . 

This  i*  the  Gauss  Seidel  iterative  method. 

We  can  also  rewrite  (1  5)  in  the  more  simple  computational  form 
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z 


1=1 


n 

^  E 
1=1*1 


1  5  1  i  n 


it  should  be  noticed  that  the  Gauss-Seidei  method  offen  two  advantages  over 
the  Jacobi  method.  The  first  is  that  the  Jacobi  method  uses  only  the  components  af 
the  approximate  vector  in  computing  the  components  of  the  (>‘'^1)st  approximate 
vector,  while  the  Gauss-Seidel  method  uses  each  component  of  the  (k*l)st  approximate 
vector  immediately  in  the  calculation  of  the  remaining  components  of  the  (k*i)st  vec¬ 
tor.  in  other  words,  the  Gauss-Seidel  method  always  uses  the  most  recent  approxima¬ 
tion  of  the  individual  components  of  an  iterative  vector  to  calculate  the  remaining 
component  while  the  Jacobi  method  does  not. 


The  second  advantage  of  the  Gauss-Seidel  method  is  that,  since  aniy  the  most 
recent  appraxi  mat  ions  are  used,  the  components  of  the  (k'^1}st  approximate  vector  may 
be  stored  in  the  some  vector  as  those  of  the  approximate  (as  soon  as  a  component  af 
the  (k*l)$t  vector  is  calculated,  it  replaces  a  component  af  the  vector).  The  Jacobi 
method,  on  the  other  hand,  requires  that  the  k^^and  (k*l)st  approximate  vectors  be  stored 
as  seporate  vectors. 


Young  determined  an  effective  way  to  accelerate  the  Gauss-Seidel  method  by 
the  use  of  ♦he  fal lowing  device.  If  x^  represents  the  (k4'1)st  approximate  vector 
as  calculated  by  the  Gauss-Seidel  method,  then  the  (k*l)st  approximation  vector  for 
the  method  of  Successive  Overrelaxation  is  gi  ven  by 


(17) 


) 


where  U)  is  some  suitably  chosen  fixed  acceleration  parameter. 


(k*I) 

Expanding  (17)  by  the  replacement  of  X  by  expression  (15),  we  hove 
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(18)  =  ,(«)  *  „(  (0-E)-' Fx<*>  ♦  (D-E)-'b  - 


•  X***  +  <»i(0'’e  x*'"'*  ♦  D*'  Fx*“*  ♦  D''b  -  x*“*  ) 


which  giv*s 

(19)  (  I  -  wD“’e)  =  (l-a»)x^‘^  +  u>D"Vx^‘^  +  wD"’b  . 

If  w«  let  L  =  D  and  U  =  D  V,  we  have 

(20)  =  ((-0/L)“M  (1-u>)l  +  wUlx^^^  +  u>(l-u»L)"’  b. 


This  is  the  formula  for  the  SOR  method. 


Returning  to  (17),  we  con  easily  obtain  the  computational  form  of  the  SOR 


method 


„„  -1  o.,xf>.b, .„.,xr', 


)=  !♦! 


The  SOR  method  possesses  all  of  the  advantages  of  the  Gauss- Seidel  method  while,  as 
will  soon  be  seen,  offering  a  significant  increase  in  the  rate  of  convergence. 


2.04  THE  BLOCK  ITERATIVE  METHOD 

In  the  development  of  the  SOR  method  up  to  this  point  each  component  of 
the  approximate  vector  hos  been  calculated  individually.  Such  a  process  is  known 
as  a  point  iterative  method.  If  related  groups  of  components  ore  solved  for  simul¬ 
taneously,  then  the  iterative  process  is  known  as  a  block  iterative  method.  Since 
the  elements  of  orientation  of  |he  photographs  ore  naturally  related  in  blocks  of 
order  6  and  the  coordinates  of  the  ground  control  points  are  naturally  related  in 
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blocks  of  order  3,  the  system  of  normal  equations  is  highly  amenable  to  block 
iterative  techniques. 

Consider  again  the  system  of  equations 

Ax  =  b  / 


only  now  let 


A  be  partitioned  into  submatrices  (blocks)  in  the  following  manner 


(21)  A 


An  A,  2  ...  A^r 

A21  A22  ...  A2r 


Afi 


‘r2 


where  the  ^ '  s  are  square  submatrices  of  A  and  the  A^^'  s  (>  +  J)  oMume  the  oppropriote 
dimensions  as  generated  by  the  diagonal  blocks.  If  A^^  hos  order  p  and  A^^  has  order  q 
then  Ajj  will  have  dimensions  px  q  and  A^^  will  hove  dimensions  qxp. 


In  a  similar  manner  let  both  the  x  and  b  vectors  be  partitioned  into  subvecton 


• 

II 

X 

CM 

4 

• 

e 

Xr 

II 

e 

e 

e 

Br 
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If  Aj  j  has  order  p,  then  both  end  will  have  dimensions  px  1 .  Then, 
in  a  manner  completely  analogous  to  the  development  of  the  point  SOR  method  the 
computotiorHil  form  of  the  block  SOR  method  con  be  obtoined. 


(23) 


=  x(“> 


ojA. 


i  i 


1-1 

-Z  A 

J  =  i 


■  1  i 


x<‘'''  -  y 


j  =  i*i 


(‘) 


(k] 


If  oil  the  submatrices  of  A  ore  single  points  (hove  dimensions  1x1),  then  the  block  SOR 
method  degenerates  nto  the  point  SOR  method.  The  theoretical  form  of  the  block  and 
point  SOR  methods  are  identical  (see  (20)1. 


2.05  CONVERGENCE 


If  we  define 


(24)  L  =  (I  -  ojL)  ((1-0!)!  +  wU) 

U) 


then  the  SOR  method  becomes 


(25)  x'  '  =  L^x 


and  the  solution  vector  x  sotisifies  the  identity 


(26)  X  =  L^x  +  uj(I-ujL)”’  D'^  b  . 


th  .  .  (k' 

If  we  define  the  error  at  the  k  iteration,  e  ',  to  be  the  difference  between  x  and 
x^  then  we  hove 
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(27)  e 


-  X  -  X 


L  X  a)(l-a)L)  ^  b 

U) 


-  (L  x^‘^  +  a)(l-u)L)"^  D“’  b) 

U) 


L  X  -  L  X 

U)  CO 

L 

CO 


(k) 


L  e 

CO 


(M 


and/  therefore/ 


(28) 


o 

II 

CO 

.(2) 

=  L  .<’> 

• 

CO 

e 

e 

.(OK  _  ,2  (0) 


CO  CO 


CO 


Hence,  if  the  initial  error  vector  e^^^  is  not  equal  to  the  null  vector,  then  it  is  obvious 
that  the  sequence  of  error  vectors 


(0)  (1)  (2) 

C  /*  /••• 


will  tend  to  the  null  vector  if  and  only  if  the  sequence  of  matrices 


L  /  /  ... 

(O  CO  CO 


tends  to  the  null  matrix.  Any  matrix  M  for  which  the  sequence  M,  M^,  M®  ,  ... 
converges  to  the  null  matrix  is  said  to  be  a  convergent  matrix.  It  can  be  shown 
(Varga,  1962)  that  an  nxn  matrix  M  is  ccxivergent  if  ond  only  if  p  (M)  <  1  where  p(M) 
is  called  the  spectral  radius  of  M  and  is  defined  by 
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p(M)  =  MAX  |X  ' 

15t£n 

wh«re  theXji  are  the  eigenvalues  of  M. 

Therefor*,-  we  hcvs  that  the  sequence  of  iterative  vectors  x^^^,  ... 

will  converge  to  the  true  solution  x  only  if  P(l-j^)  ^  Varga  proves  that  if  the  matrix 
A  in  the  equation 

A  X  =  b 

is  symmetric  and  positive  definite  (as  i$  the  cose  for  »Se  coefficient  matrix  of  the 
normal  equations)  then  p(l-^)  <  1  if  and  only  if  0  <  cu  <  2  . 

Thus,  the  convergence  of  the  SOR  method  when  applied  to  the  system  of  normal 
equations  has  'low  been  guaranteed  provided  that  cu  is  chosen  such  that  0  <  cu  <  2. 
The  question  which  now  arises  is  the  determination  of  a  value  for  U)  which  will  yield 
the  fastest  rate  of  convergence.  In  order  to  be  able  to  develop  an  explicit  formula 
for  an  optimal  U),  we  must  be  assured  that  the  coefficient  matrix  A  possesses  certain 
additional  properties  conjointly  with  symmetry  and  positive  definiteneu.  Specifically, 
the  coefficient  matrix  A  must  be  what  Varga  defines  os  a  consistently  ordered  2-cyclic 
matrix.  This  is  equivalent  to  Young's  definition  of  a  consistently  ordered  matrix 
possessing  block  Property  A.  Through  the  use  of  the  crdering  vectors  (os  defined  by 
Varga)  associated  with  the  orrangements  of  the  coefficient  matrices  of  the  normal 
equations  indicated  in  Figures  1.2  and  1.4,  it  can  easily  be  shown  that  both  of  these 
matrices  satisfy  the  additional  hypotheses. 

If  the  coefficient  matrix  is  a  consistently  ordered  2-cyclic  matrix,  Varga 
proves  that  the  optimum  acceleration  parameter  (u  (optimum  in  the  sense  that 
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P(L  )  =  0  <  (i)  <  2)  can  be  explicitly  calculated  by  the  formula 


(»)  - 


1  +  yi  -p(G) 


where 

(30)  G  =  (I  -  L)"’  U  . 


Varga  also  shows  that 

Under  the  above  conditions  on  A,  it  is  also  true  (Vargo)  that#  If  X  is  o  non¬ 
zero  eigenvalue  of  and  If  pi  satisfies 

(31)  (X+  w  -  1)2  =  X  w2  42, 


then  4  is  an  eigenvalue  of  B  =  L  +  U.  Conversely,  if  4  it  on  eigenvalue  of  B  and  X 
satisfies  (31),  then  X  is  an  eigenvalue  of  . 

If  u)  is  set  equal  to  1  in  (20)  then  we  have 

(32)  L  ,  =  (l-L)"'  U  =  G 

U) 

and  the  SOR  method  reduces  to  the  Gauss-Seidel  method. 


With  o)  =  1  oixJ  an  application  of  (31),  we  see  that,  if  4  is  an  eigenvalue  of 
B/  then  42  it  an  eigenvalue  of  G.  Hence,  p(G)  =p2(B)  ondp(G)  <  p(B)  since 
P(G)<  1. 
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The  role  of  convergence  R(M)  of  a  matrix  M  is  defined  by  (Young) 


(33)  R(M)  =  -  log  (p(M))  . 

Hence,  we  hove  R(G)  -  2R(8)  and,  under  the  previously  mentioned  conditions  , 
we  have  that  the  Gauss-Seidel  method  (G)  converges  twice  as  fast  os  the  Jacobi 
method  (  8  =  L+U  =  D  \e+F)  )  .  It  can  also  be  shown  (Varga)  that 

(34)  lim  R(L  )  =  2(R(G)1*, 

p(8)-r  ^ 

which  gives  us  that 

(35)  il(L  )  3  aii(G)l*  >  a(G). 

Hence,  the  SOR  method  with  the  optimum  acceleration  parameter  converges  approx¬ 
imately  twice  os  fflist  osymptoticaHy  os  does  the  Gauss-Seidel  method.  It  must  be 
emphasized  that,  in  actual  practice,  the  SOR  method  can  and  often  does  offer  a 
much  larger  increase  in  the  rate  of  convergence.  This  is  due  to  the  fact  that  the 
result  in  (35)  is  developed  only  for  the  limiting  case  p(B)  —  1 , 

The  effect  of  using  the  block  SOR  method  is  to  again  increase  the  rate  of 
convergence  although  no  general  relationship  is  known,  (For  a  result  restricted 
to  partial  differential  equations  see  Arms,  Gates  and  Zondek,  1956),  Intuitively,  we 
may  view  the  use  of  the  block  SOR  method  as  having  the  effect  of  reducing  the 
order  of  the  system  of  equations  thus  making  the  iterative  process  converge  more 
rapidly. 
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Rather  than  attempt  to  compute  p(G)  explicitly,  one  can  approximate  it 
in  the  following  manner  (Young,  1962):  Set  (u  =  1  in  formula  (21)  and  perform 
several  iterations  while  calculating 


(36) 


P(G)  a 


where 

(37)  jx]|  H  max  jx  '  . 

2.06  OTHER  ITERATIVE  METHODS 

In  the  early  stages  of  our  study  another  iterative  method,  that  of  Luistemilc 
■  as  described  by  Foadeva  (1959),  was  investigated.  The  formula  for  this  method  is 


(38) 


where  x^^  is  the  (k*i)*^  opproximation  obtained  by  the  Gauss-Seidel  process  and  p 
equals  p(G)  with  G  defined  os  in  (3C). 


We  would  errphosize  that  our  studies  have  by  no  means  covered  all  iterative 
methods  worthy  of  consideration.  The  fact  that  other  methods  were  not  applied  to  the 
photogram  metric  problem  is  in  large  measure  attributable  to  the  very  satisfactory  results 
which  were  obtained  with  the  Method  of  Successive  Over  Relaxation.  Also  some  of  the 
iterative  methods  are  highly  specialized  to  apply  to  matrices  generated  for  the  numerical 
solution  of  certain  systems  of  partial  differential  equations  and  are  inherently  unsuited 
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to  cjr  problem.  The  entire  field  of  semi-iterotive  procedures  (Varga)  has  yet 
to  be  opplied  to  the  photogrommetric  problem.  A  particularly  promising  solution 
referred  to  as  Block  Symmetric  Successive*  Over  Relaxation  (Ehrlich/  1963)  came 
to  our  attention  os  we  were  completing  our  studies  for  tMs  report.  This  is  a  two 
step  method  in  which  the  solution  vector  proceeds  first  from  the  top  of  the  matrix 
to  the  bottom  in  the  usual  manner  but,  then,  imteod  recycling  to  the  top  again  os 
in  normal  Successive  Over  Relaxation/  it  reverses  and  proceeds  from  bottom  of  the 
matrix  backwards  to  the  top.  In  some  applications  the  method  has  been  found  to 
yield  a  substantial  improvement  in  convergence  over  Block  Successive  Over  Relax¬ 
ation  with  no  increase  in  computation.  Accordingly/  we  would  strongly  recommend 
that  Block  Symmetric  Successive  Over  Relaxation  receive  serious  consideration  in 
arty  future  investigotiorts  of  the  photogrommetric  application. 

Within  the  past  decade  or  io,  the  field  of  itera'ive  techniques  for  the  solution 
of  simultoneous  linear  equations  has  become  a  very  fen  le  area  of  investigation  with 
new  and  significant  results  appearing  at  frequent  intervals.  It  is  our  intention  to  keep 
abreast  of  latest  developments  and  to  investigate  those  which  would  appear  to  hove 
particular  merit  in  the  photogrommetric  application.  Although  we  are  immensely 
satisfied  with  the  results  obtained  so  far,  we  are  certain  that  they  can  be  and  will 
be  oppreciobly  improved  upon  before  very  long. 

2.07  GENERAL  APPROACH  TO  NUMERICAL  SIMULATION 

Inasmuch  as  several  possible  combinations  of  iterative  techniques  and  arrange¬ 
ments  presented  themselves  at  the  outset/  we  decided  to  confine  the  initial  phase  of 
the  study  to  the  application  of  various  approaches  to  the  solution  of  simulated  strips 
of  photography.  Both  economics  and  logic  dictated  such  a  course  of  action/  for  it 
was  clear  that  if  an  occeptable  solution  could  not  be  found  for  o  strip  of  photography 
the  possibility  of  developing  an  acceptable  solution  for  large  blocks  would  be  even 
more  remote.  On  the  other  hand/  succeu  with  strips  of  photos  v  ould  warrant  extension 
of  the  approach  to  embrace  blocks. 
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A  procea  of  eliminotion  was  carried  out  in  order  to  determine  which 
specific  combination  of  iterctive  method  and  arrangement  of  normal  equations 
would  yield  the  highest  rate  of  convergence.  In  order  to  obtain  results  which 
would  be  as  meaningful  as  poaible/  It  was  necessary  to  generate  systems  of  normal 
eqtjotiorw  similar  in  general  character  to  those  to  be  expected  from  actual  data. 

For  (onvrtnience,  we  adopted  a  perfect  9-point  pattern  of  ground  control.  This 
osiumpticn  in  rto  way  compromises  the  essential  validity  of  the  simulation  and 
serves  to  simplify  the  data  har>dling.  In  our  initiol  simulations  involving  2-photO/ 
6-photo  and  ?5-photo  strips,  the  ground  points  were  oaumed  to  lie  in  the  horizontal 
X-Y  plane  and  to  be  spoced  at  18,000  ft.  intervals  in  both  X  and  Y.  Flying  height 
was  taken  as  40,000  ft.  from  all  photos.  This  combination  of  flying  height  and 
spacing  of  control  points  is  appropriate  to  two  thirds  forward  overlap  with  a  150mm 
(6  inch)  lens  and  o  19cm  (7.5  inch)  plate  format.  In  our  later  simulations  involv¬ 
ing  41  photo  strips  and  3x5  blocks,  the  basic  nine  point  pattern  was  maintained, 
but  the  flying  height  w<a  raised  (in  accord  with  RAOC  requests)  to  50,000  ft.  and  the 
spacing  of  ground  control  was  increased  to  30,000  feet  (a  combination  oppropriate  to 
60%  forward  overlap  with  a  6  inch  lens  and  a  9x9  inch  format).  The  X  axis  was 
considered  to  be  defined  by  the  flight  line,  along  which  the  middle  row  of  ground 
control  points  was  also  assumed  to  lie.  The  x,y  plate  coordinate  axes  were  taken 
to  be  parallel  to  the  X,Y  axes,  thus  rendering  the  0,  u,  K  for  each  photo  equal  to 
0*,  0*  and  90”  respectively.  The  general  geometry  of  the  simulated  photography  is 
illustrated  in  Fig.  2.1. 

The  true  coordinates  of  the  control  points  and  the  true  elements  of  orientation 
were  employed  to  generate  the  true  plate  coordinates  of  the  images  of  the  grourKi 
control.  Random  normal  deviates  having  the  standard  deviations  indicated  in  Table 
2. 1  were  added  to  the  true  elements  of  orientation  and  the  true  coordinates  of  con¬ 
trol. 
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STANDA-RD  DEVIATION 

Quantity 

2-Photo  Strip 

6-Photo  Strip 

25-Photo  Strip 

41 -Photo  Strip 

3x5  Photo  Block 

10ft. 

25  ft. 

"o'  “u' 

.0003  radian  (1*) 

.00075  rodian  (2*. 5) 

10  ft. 

25  ft. 

Table  2.1 .  Standard  deviations  of  random  normal  deviates  added  to  true 
values  of  elements  of  orientotion  and  coordinates  of  control 
in  order  to  create  simulated  approximations. 


No  random  normal  deviates  were  applied  to  those  control  points  which  were 
considered  to  be  absolute  in  a  given  simulation.  Except  for  such  absolute  control 
points,  no  constraints  were  placed  on  the  control  points.  Neither  were  constraints 
placed  on  the  elements  of  exterior  orientation  (the  elements  of  interior  orientation 
were,  of  course,  enforced).  Accordingly,  all  pass  points  and  all  elements  of 
exterior  orientation  were  allowed  unlimited  freedom  to  adjust. 

The  random  deviates  having  standard  deviations  as  indicated  In  Table 
2.1  lead  to  fairly  close  initial  approximations  by  usual  standards.  Such  close 
approximations  were  invoked  in  order  to  avoid  contamination  of  the  essential 
results  by  second  order  effects  of  the  process  of  linearization  by  means  of  Taylor's 
series.  As  Indicated  in  Table  2.1,  in  our  later  simulations  (41-Photo  strip  and  3x5 
block)  the  errors  in  the  initial  approximations  were  relaxed  by  a  factor  of  2.5. 

No  random  errors  were  applied  to  the  true  plate  coordinates  in  any  of  the 
simulations,  for  had  this  been  done  the  exact  solution  of  the  normal  equations 
would  not  have  been  known.  As  it  is,  the  solution  of  the  normal  equations  should 
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precisely  reproduce  the  known  random  deviotes  which  hod  been  odded  to  the  true 
eletnents  of  orientation  ond  coordinates  of  control.  This/  then,  provides  the 
standard  needed  to  gauge  the  relative  effectiveness  of  various  opproaches  to  the 
solution  of  the  normal  equations.  One  should  not  lose  sight  of  the  fact  that  the 
central  abjective  of  our  entire  program  of  numerical  simulation  is  to  determine 
the  feasibility  of  solvir>g  the  normal  equations  by  means  of  certain  iterative  pro¬ 
cedures.  Irtasmuch  os  the  introduction  of  random  errors  in  the  plate  measurements 
would  induce  only  a  second  order  change  In  the  coefficient  matrix  of  the  normal 
equotiom  ond  hence  would  not  alter  its  essential  properties  pertaining  to  conver¬ 
gence,  it  Is  clear  that  the  assumption  of  perfect  plate  measurements  in  noway 
compromises  the  validity  of  our  investigation  of  iterative  solutions. 


Four  different  arrangements  of  the  normal  equations  were  investigated  in 
our  simulations  of  strips.  The  basic  forms  of  the  normal  equations  are  illustrated 
In  Figures  2.2,  2.3,  2.4,  2.5  for  the  case  of  a  sample  1x5  strip.  In  the  arrange¬ 
ments  A  and  B  (Figs  2.  2,  2.3)  the  elements  of  orientation  and  the  coordinates  of 


control  are  totally  seporoted.  The  numbering  of  control  points  leading  to  the  form 
A  is  indicated  in  Fig.  2.6  and  that  leoding  to  the  form  B  is  indicated  in  Fig.  2.7. 
The  arrangements  C  and  D  (Figs.  2.4,  2.5)  are  intertwined  forms.  Both  intertwined 
forms  correspond  to  the  numbering  of  control  points  of  Fig.  2.7.  The  C  form  may  be 
viewed  as  a  special  cose  of  the  block  intertwining  of  Fig.  1 .5.  In  the  D  form,  an 


even  tighter,  and  more  strongly  diagonol  arrongement  is  achieved  through  a  different 


ordering  process.  The  unkr>owns  for  the  C  and  D  forms  are  ordered  as  follows: 


C  FORM 


D  FORM 


Point  1 
Photo  1 
Points  2,3,4 
Photo  2 
Points  5,6,7 
Photo  3 
Points  8,9, 10 


Photo  4 

Points  11,  12,  13 
Photo  5 


Points  14  through  21 


Points  1 ,2, 3, 4, 5 
Photo  1 
Points  6,7,8 
Photo  2 
Points  9,10,11 
Photo  3 

Points  12,13,14 
Photo  4 

Points  15, 16, 17 
Photo  5 

Points  18,19,20,21. 
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Figure  2.2a.  The  A  form  of  the  coefficient  matrix  of  the  general  normal  equations  Figure  2.2b.  Collapsed  form  of  normal  equations  of  Fig.  2.2a. 

arising  from  adjustment  of  1x5  strip  of  photography  with  photos  and  control 
points  numbered  as  in  Fig.  2.6. 


* 


^  I 

i  i 


....  I  5, 

....  Q_ 

_  _o 


P  _C 


u  o 
IS  «. 

^  I 

o  t 


ll 


^  a» 
eo  c 


control  points  numbered  os  in  Fig.  2.7. 


^mS<*i&€Sw 

niK  •N%%V«9 1 

piw^ 


ii^pMl^Pi 
!?:?:!  .§:S:*§::;:§:?^^S‘: 


mmm 


K*A>gW>2iV 

S.iC;r?..v**.S!&- 

SfiSS5S??5>; 

►}M«J‘***X'WJ' 


mmm 

I  »%?<?  »T«*W  »%:*!■ 


>S5:>?5! 

1 

*•"••«  WJWi 

»I«  *%:•  •.♦Nv  »W!«  1 

itrix  of 
5  strip 


.*z*z*z*z*z* 

>5?S?5' 

•VWrW>%T 

■»M»K 


A  4  *  •  4  4r»  4  4 

;%*:S*w?w: 


.’-•i  .V^* 


Figur*  2  .6-  G*n«rol  vh«m«  of  pf<oto  ond  coofrol  poinf  numboring  loading  to  A  fotm  of  norinal  •quationi  for  strip. 


FIgur*  2- 7.  G«n«rol  Kh«m«  of  photo  ond  control  point  numboring  loading  to  B,  C,  D  forms  of  normol  oquotioni  for  strip. 
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In  the  next  several  subeectionr  we  shall  describe  the  results  of  our  simu¬ 
lations  and  shall  show  haw  each  series  of  simulations  answered  certain  specific 
questions  while  raising  still  others  which  were  in  turn  answered  by  subsequent 
simulations. 

2.08  SIMULATIONS  OF  2-PHOTO  STRIPS  USING  POINT  ITERATIVE  METHODS 

The  basic  2-photo  combination  is,  of  course,  the  fundamental  unit  for 
photogrammetri c  triangulation  and  is  the  combination  which  has  traditionally  been 
exploited  as  the  'building  block'  for  contilever  extension.  We  concentrated 
initially  on  the  2-photo  unit  mainly  in  order  to  become  familiar  with  the  'mechanics' 
of  the  various  approaches  to  be  applied  later  to  more  extensive  photogrammetri c 
nets.  The  four  corner  points  of  the  first  photo  were  taken  as  absolute  control 
points.  The  middle  control  point  of  the  first  column  and  all  three  control  points 
of  the  last  colifmn  were  considered  to  be  known  perfectly  in  Z  in  order  to  preserve 
the  basic  nine  point  pattern  (since  these  particular  points  do  not  lie  in  overlap 
areas,  they  must  be  constrained  in  at  least  one  coordinate  in  order  to  be  corried 
in  the  adjustment;  being  constrained  only  in  Z,  the  con  have  no  influence  on  the 
results  of  the  odjustment  and  accordingly  may  be  viewed  as  dummy  control  introduced 
merely  for  convenience).  With  a  total  of  12  control  points  being  carried,  the 
general  normal  equations  for  the  2-photo  strip  become  of  order  48x48.  All  four 
(HTongements  of  the  normal  equations  (A,B,C,D)  were  generated  on  an  IBM  1620 
computer  and  solutions  were  attempted  by  means  of  the  following  'point-iterative' 
processes 

1.  Gguu- Seidel, 

2.  GauM-Seidel  with  Luisternik  Acceleration, 

3.  Successive  Over  Relaxation, 

The  results  for  Gauss-Seidel  iteration  for  all  four  arrangements  of  the  normal 
equations  are  summarized  in  Table  2.2.  Those  for  Successive  Over  Relaxation 
ore  summarized  in  Table  2.3.  The  Gauss-Seidel  process  with  Luisternik  acceleration 
wos  found  to  diverge  for  reasons  to  be  discussed  later. 
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Number  of 

r  "  -  '■  • 

ARRANGEMENT  OF  NORMAL  EQUATIONS 

Iterations 

A 

B 

C 

D 

m 

S 

p  (G) 

S 

p  (G) 

S 

P  (G) 

S 

p  (G) 

m 

m 

m 

m 

m 

m 

m 

m 

5 

9.320 

.8184 

9.320 

.8184 

8.527 

.8062 

13.630 

.6462 

10 

4.339 

.8523 

4.339 

.8523 

4.485 

.9058 

5.370 

.9063 

15 

2.210 

.8468 

2.210 

.8468 

2.366 

.9117 

3.016 

.9392 

20 

1.302 

.9086 

1.302 

.9086 

1.667 

.9267 

2.210 

.9448 

25 

.982 

.9861 

.982 

.9861 

1.397 

.9440 

1.808 

.9534 

30 

.839 

.9881 

.839 

.9881 

1.231 

.9583 

1.532 

.9593 

35 

.773 

.9890 

.773 

.9890 

1.130 

.9932 

40 

.699 

.9897 

.699 

.9897 

Table  2.2  Valuei  of  convergence  parameter  ond  ettimoted  ipectrol  radlui  p  (G)  for  every 


5  iterations  of  point-iterative  Gauss-Seidel  process  applied  to  normal  equations  for 
basic  2-photo  strip. 


Number  of 

ARRANGEMENT  OF  NORMAL  EQUATIONS 

Iteratians 

A 

B 

C 

D 

m 

S 

S 

P  (G) 

S 

p  (G) 

S 

p  (G) 

m 

m 

m 

m 

m 

m 

m 

5 

9.321 

.8184 

9.321 

.8184 

10.180 

.8083 

13.630 

.6462 

10 

6.871 

.8531 

6.158 

.6974 

6.657 

.8187 

8.685 

.7293 

15 

3.164 

.9036 

3.071 

.9050 

3.291 

.9009 

6.367 

.8185 

20 

2.289 

.9730 

2.478 

1.0020 

2.836 

.9878 

4.171 

.9147 

25 

1.855 

.9683 

2.049 

.9718 

2.439 

.9625 

2.714 

.9501 

Table  2.3.  Values  of  convergence  parameter  S  and  estimated  spectral  radius  p  (G)  for  every 

m  m  ' 

5  iterations  of  point-iterative  method  of  Successive  Over  Relaxation  applied  to 
normal  equations  for  basic  2-photo  strip. 
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In  Tables  2.2  and  2.3  the  quantity  S  ,  defined  by 


s 

m 


t=l 


,  .  .  ,  (m)  .  (m-1) 

serves  os  the  criterion  for  convergence.  Here  and  ore  corresponding 

components  of  two  successive  opproximotions  to  the  solution  vector  of  the  normal 

equations,  ’ine  quantity  p  (G)  denotes  the  approximation  to  the  spectral  radius 
th  ^ 

resulting  from  the  m  iteration.  The  time  required  per  iteration  on  the  IBM  1620 
was  minutes  in  oil  coses.  It  should  be  pointed  out  that  all  operations  were  per¬ 
formed  on  the  full  4&(48  coefficient  matrix,  for  the  collapsed  form  was  not  employed 
at  this  stage  of  the  investigation. 


From  Table  2.2  we  see  that  the  results  for  the  A  and  B  arrangements  are 
identical  arsd  ore  suoerioi'  in  convergneco  to  those  for  the  C  and  D  arrangements. 

In  comparing  Tables  2.2  and  2.3  we  see  that  the  point-iterative  Gauss-Seidel 
process  actually  converges  more  rapidly  than  the  point-iterative  Method  of  Successive 
Over  Relaxation.  This  indicates  that  the  Method  of  Successive  Over  Relaxation  did 
not  realize  a  good  approximation  to  its  optimum  acceleration  parameter  within  the 
span  of  iterations  considered. 

The  most  important  finding  of  the  simple  2-photo  simulations  was  the  demon¬ 
stration  that  the  Luisternik  acceleration  actually  leads  to  divergence.  Upon 
reviewing  this  result  from  the  theoretical  standpoint  the  reason  became  obvious. 

The  Luisternik  process  may  actually  be  viewed  as  a  special  cose  of  the  Method  of 
Successive  Over  Relaxation  in  which  the  acceleration  parameter  u  is  computed  from 

“  -  rw  • 


As  was  indicated  in  Subsection  2.05»  the  SOR  process  will  converge  only  for 
0  <  u  <  2.  Thus  when  u  is  computed  according  to  the  above  formula,  convergence 
will  result  only  if  p(G)  <  0.5.  In  the  general  photogrammetric  problem,  on  the 
other  hand,  p(G)  is  generally  close  to  unity.  This  makes  Luisternik*  s  acceleration 
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coefficient  greater  than  2  which  in  turn  causes  divergence.  When  p(G)  <  0.5/ 
Luisternik's  choice  for  the  acceleration  parameter  is  related  to  the  optimum 
parameter  by  the  following  approximation 


(40) 


u 


Luisternik 


(1  p(G))  u 


Optimum* 


Hence  even  when  it  leads  to  convergence  the  Luisternik  acceleration  parameter 
tends  to  overshoot  the  optimum  accelerotion  parameter  by  a  factor  equal  to  the 
spectral  radius. 


2.09  SIMULATIONS  OF  2-PHOTO  STRIPS  USING  BLOCK-ITERATIVE  METHODS 

Having  dismissed  the  Luisternik  method  in  our  initial  point-iterative  simu¬ 
lations/  we  proceeded  to  apply  block-iterative  methods  to  the  bosic  2-photo  case. 
Here,  os  in  all  subsequent  simulations/  we  employed  an  IBM  1620  cr>mputer  to 
generate  the  normal  equations  and  an  IBM  7094  to  solve  them.  At  this  point  we 
decided  to  concentrate  on  one  non- intertwined  form  of  the  normal  equations  and 
one  intertwined  form.  The  B  arrangement  was  selected  for  the  non-intertwined 
form  because  its  implementation  was  considered  to  be  somewhat  easier  then  that 
of  the  A  form.  The  D  nrrangement  was  selected  for  the  intertwined  form  becouse 
i»  Is  more  strongly  diagonal  than  the  C  arrangement. 

The  method  of  Block  Successive  Over  Relaxation  was  applied  to  both  the 

B  and  D  forms.  To  serve  as  a  control/  the  Block  Gauss-Seidei  process  was  applied 

to  the  B  form.  The  convergence  criterion  S  and  estimated  spectral  rodi us  p  (G) 

m  m 

were  read  out  at  the  end  of  every  tenth  iteration  and  are  listed  in  Table  2.4  for 
the  three  cases  considered. 


The  results  in  Table  2.4  demonstrate  that  the  rate  of  convergence  of 
Block  Successive  Over  Relaxation  far  exceeds  that  of  the  Block  Gauss  Seidel 
Process,  being  on  the  order  of  40  to  50  times  faster  at  100  iterations.  In  com¬ 
paring  Tables  2.2  and  2.4  we  see  that  the  block-iterative  Gauss  Seidel  process 
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_  TY 

PE  OF  ITERATIVE  SOLUTION 

Number  of 

B,OCK  GAUSS 

-SEIDEL 

BLOCK  SUCCESSIVE 

OVER  RELAXATION 

Itera  tions 

B  FORM 

BFORM 

D  FORM 

S 

p  (G) 

S 

S 

m 

m 

m 

m 

m 

m 

10 

S.693 

.9239 

18.34 

.9590 

8.013 

.8978 

20 

3.098 

.9197 

1.798 

.9268 

3.644 

.7709 

30 

1.819 

.9254 

.5516 

.9316 

.4887 

.7909 

40 

1.125 

.9449 

.2690 

.9320 

.1297 

.9523 

50 

.7198 

.9498 

.1320 

.9311 

.0635 

.9454 

60 

.4769 

.9522 

.0648 

.9253 

.0357 

.9485 

70 

.3302 

.9836 

.0318 

.9323 

.0202 

.9373 

80 

.2413 

.9847 

.0158 

.9042 

.0151 

.9317 

90 

.1818 

.9826 

.0076 

.9163 

.0065 

.9509 

100 

.1411 

.9829 

.0039 

1.0370 

.0037 

.9556 

no 

j 

.1138 

.9824 

.0019 

.9612 

.0022 

1.049 

Table  2.4.  Vak*«s  of  convergence  po-ameter  and  estimated  spectral  radiusp  (G)  for 

10  iterations  of  block-iterotion  Gauis-Seidel  Process  and  block- iterative  Method 
of  Successive  Over  Relaxation  applied  ro  normal  equations  of  basic  2-photo  strip. 


Number  of 
Iterations 

B  FORM 

D  FORM 

s 

m 

fn 

S 

m 

P  (G) 

16 

SOS 

3C 

6. 186 

.9847 

5.067 

.9716 

50 

3.049 

.9614 

3.634 

9930 

70 

1.511 

.9770 

2.746 

.9827 

90 

.7854 

.9760 

2.159 

.9953 

no 

.4976 

.9651 

1.777 

.9947 

130 

.4020 

.9793 

1.537 

.9955 

150 

.3490 

.9910 

1.389 

.9954 

170 

.3077 

.9948 

1.2S1 

.9961 

190 

.2723 

.9975 

1.199 

.997  A 

210 

.2404 

t.002 

1.134 

.9971 

Table  2.5.  Values  of  convergence  parameter  and  estimated  rpectral  radiusp  (G)  for  every 
20  iterations  of  block- iterative  Method  of  Successive  Over  Relaxati^  applied  to 
simulated  1x6  strip. 
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actually  tends  to  converge  less  rapidly  than  the  point-iterative  Gouss-Seidel 
process.  On  the  other  hand  in  conjporing  Tobies  2.3  ar^d  2.4  we  see  that  pre¬ 
cisely  the  opposite  is  true  with  Successive  Over  Relaxation;  here  the  block- 
iterative  procedures  afford  a  very  considerable  improveme?  •:  over  point  iterative 
procedures. 

The  general  rate  of  convergence  with  Block  Successive  Over  Relaxation 
is  seen  from  Table  2.4  to  be  odout  the  same  for  the  B  and  D  orrangemenh.  Cer¬ 
tainly,  ths  D  arrangement  in  this  cose  does  not  provide  the  hoped  for  improvement 
motivating  the  concept  of  intertwining. 

2. 10  SIMULATION  OF  6-PHOTO  STRIPS 

At  this  point  it  was  thought  that  the  failure  of  intertwining  to  offer  a 
significant  improvement  in  convergence  might  well  be  attributable  to  the  fact 
that  with  such  a  short  strip  only  a  weak  measure  of  relative  diagonality  is  pro¬ 
vided  by  intertwining.  For  this  reason,  we  decided  to  continue  our  investiga¬ 
tions  of  intertwining  in  further  parallel  simulations  of  the  B  and  D  arrangements 
of  the  normal  equations.  Accordingly,  the  original  2-photo  strip  was  extended 
to  a  6-photo  strip.  This  produced  a  system  of  normal  equations  of  order  108x108, 
thus  providing  the  D  intertwined  form  a  chance  to  achieve  a  fair  measure  of 
diagonality. 

The  results  of  210  iterations  of  the  process  of  Block  Successive  Over 
Relaxation  are  indicated  in  Table  2.5  for  every  20th  iteration  starting  with  the 
10th.  We  see  that  instead  of  leading  to  an  improvement  in  convergence,  the 
intertwined  form  D  actuc.lly  retards  convergence  to  an  appreciable  degree  and 
at  210  iterations  is  about  five  times  slower  in  converging  than  the  B  form.  Thus 
the  actual  effect  of  intertwining  would  appear  to  be  just  the  opposite  of  what 
was  desired. 
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In  on  ttempt  to  account  for  this  result,  we  investigated  frori  the 
theoretical  standpoint  the  structural  properties  characteristic  of  intertwined 
forms.  As  stated  in  Subsection  2.05,  through  the  use  of  ordering  vectors  it 
can  be  established  that  the  simple  arrangements  A  ond  B  of  the  rK>rmal  equc- 
tions  are  consistently  ordered  2-cyclic  matrices,  hi  a  similar  manner  we  hove 
been  able  to  establish  thot  the  more  complex  intertwined  arrangements  C  arid 
D  ere  not  ?-cyclic.  It  follows  that  formula  (29)  for  estimoting  the  optimum 
occelerotiai  fsarometer  is  not  theoretically  valid  for  the  intertwined  forms. 

Vargo  (1962)  states  that  the  rate  of  convergence  of  Successive  Over  Relaxation 
can  be  extremely  sensitive  to  changes  in  the  acceleration  parameter.  It  is 
evident  from  our  numerical  results  that  equation  (29)  does  not  yield  the  ijptimum 
acceleration  parameter  for  the  intertwined  arrangements  and  hence  the  -noximum 
rote  of  convergence  of  Successive  Over  Relaxation  is  not  achieved  witfr  inter¬ 
twining.  Inasmuch  os  no  formula  Is  known  for  computing  the  optimum  acceleration 
parameter  for  matrices  which  are  not  consistently  ordered  2  cyclic,  wn  decided 
to  abondon  further  consideration  of  intertwining  in  subsequent  numerical  sirriula- 
tions. 

2. 1 1  SIMULATION  OF  25-PHOTO  STRIPS 

The  investigations  to  this  point  were  largely  exploratory,  serving  to 
suggest  avenues  meriting  more  intensive  invest!  got  I  on.  While  the  iterotive 
reduction  for  the  6-photo  strip  did  lead  to  o  satisfc!'‘tory  solution  the  normal 
equations,  the  over-cll  computing  time  was  almost  tenfold  greater  hon  that  which 
would  have  been  required  by  the  direct  reduction  of  Subsection  1.12.  Nonethe¬ 
less,  the  fact  that  a  satisfactory  solution  had  been  obtained  at  all  was  considered 
to  be  encouraging  because  the  iterative  approach  was  not  expected  to  be  computa¬ 
tionally  superior  for  such  small  photogrammetric  nets. 
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Having  settled  on  a  tingle  arrangement  of  the  normal  equations  (the 
B  form)  and  a  tingle  iterative  method  of  solution  (Block  Successive  Over  Relax- 
otion)  we  proceeded  to  revise  the  solution  to  incorporate  a  collapsing  algorithm 
in  order  to  bypan  unnecessary  operations  on  blocks  of  zero  elements.  With  this 
tuccenfully  accomplished/  we  tested  the  resulting  version  of  the  reduction  on 
the  6-photo  strip  and  found  that  the  collapsing  algorithm  speeded  the  reduction 
by  more  than  one  third.  By  implementing  the  collapsing  algorithm,  we  not  only 
speeded  the  reduction  but  were  also  able  to  handle  much  larger  matrices  in  core, 
for  storage  of  blocks  of  zero  elements  was  no  longer  required.  This  set  the  stage 
for  our  next  series  of  simulations  which  were  concerned  with  25-photo  strips. 

The  25-photo  strip  was  selected  because  this  was  judged  to  be  close  to  the  cross¬ 
over  point  where  the  iterative  approach  would  possibly  emerge  os  computationally 
superior.  The  order  of  the  general  normal  equations  for  the  25-photo  strip  is 
393x393. 

In  the  25-photo  simulations  the  basic  nine  point  pattern  was  maintained 
and  two  levels  of  control  were  considered: 

(1)  four  absolute  control  points  at  the  beginning  of  the  strip  and  none 
elsewhere  (minimal  control  case); 

(2)  four  absolute  control  points  at  the  beginning  and  another  four  at 
the  end  of  the  strip  and  none  elsewhere  (augmented  control  case). 

Three  non-collinear  control  points  (or  more  precisely  2-1/3  points)  actually  consti¬ 
tute  a  minimal  control  situation;  by  including  a  fourth  control  po'nt  in  the  set,  we 
obtain  a  practical  check  through  redundancy.  Since  such  a  check  should,  we  feel, 
be  cons'dered  to  be  virtually  indispensible  in  practice,  we  regard  a  set  of  four 
absolute  control  points  as  constituting  the  'minimal  control  cose'  . 

Inasmuch  cs  the  plate  coordinates  were  completely  un contaminated  by 
random  error,  the  root  mean  square  (rms)  error  of  the  residuals  of  the  plate 
coordinates  was  adopted  as  an  alternative  criterion  of  convergence.  This  was 
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f«U  to  be  more  meaningful  for  the  problem  at  hond  than  our  earlier  criterion. 

For  a  perfect  solution,  the  rms  error  would,  of  course,  be  precisely  zero.  With 
real  data,  on  the  other  hand,  the  nrs  error  would  stabilize  at  a  higher  level  and 
a  more  appropriate  criterion  would  be  one  based  on  the  change  in  the  rms  error 
per,  say,  twenty  iterations. 

The  new  convergence  criterion  was  computed  and  read  out  every  20 
iterations  until  an  arbitrary  cut-off  level  of  300  iteratiom  was  reached.  The 
results  for  both  cases  are  listed  in  Table  2.6.  On  the  surface,  the  level  of 
0.38  and  0,35  microns  attained  by  300  iterations  is  quite  impressive,  particularly 
when  considered  in  the  light  of  normal  plate  measuring  accuracies.  However, 
gauging  the  convergence  criterion  in  this  manner  is  deceptive  for  reasons  to  be 
brought  out  in  Figs.  2.8a  through  2.12b.  Here  we  have  presented  curves  de- 
pictirsg  the  actual  errors  in  the  solutions  for  the  various  unknowns  of  tfie  normal 
equations.  For  convenience  in  making  comparisons  we  hove  placed  in  juxtaposition 
ccrespondi ng  figures  for  the  ‘minimal  control  case*  and  the  'augmented  control 
cose*  .  Corresponding  figures  are  given  the  seme  number  with  the  suffix  '  a* 
referring  to  the  'minimal  control  case'  and  the  suffix  '  b*  corresponding  to  the 
'augmented  control  case' . 

In  comparing  Figs.  2.8a  end  2.8b  we  have  the  first  indication  of  what  we 
shall  coll  the  'pinch'  effect  of  obsolute  control.  The  truncation  errexs  in  <P,  u,  K 
in  Fig.  2.8b,  unlike  those  in  2.8a,  are  reduced  almost  to  zero  at  the  25th  photo. 
This  reflects  the  effects  of  the  absolute  control  present  at  the  end  of  the  strip  for 
the  'augmented  control  case'  .  Not  only  does  this  extra  control  pinch  the  truncation 
error  almost  to  zero  at  the  :.nd  of  the  strip,  but  it  also  reduces  scxnewhat  the  ampli¬ 
tude  of  the  intermediate  excursions.  The  tip  (O),  tilt  (u),  and  swing  (k)  errors  are 
suppressed  for  the  most  part  to  less  than  5  seconds  of  arc  by  300  iterations. 

Ti.c  pinch  effect  Is  also  evident  in  the  comparison  of  Figs.  2.9a  and  2.9b. 

By  the  end  of  300  iterations,  the  errors  in  the  volues  of  the  coordinates  X^,  Y^, 
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Number  of  Iterations 

RMS  ERROR  (MICRONS) 

Augmented  Control  Cose 

0 

183.8 

179.4 

20 

1.87 

1.85 

40 

1.30 

1.25 

60 

1.01 

.94 

80 

.84 

.73 

100 

.73 

.68 

120 

.66 

.61 

140 

.61 

.56 

160 

.57 

.51 

180 

.53 

.48 

200 

.50 

.45 

220 

.47 

.43 

240 

.45 

.40 

260 

.42 

.38 

280 

.40 

.37 

300 

.38 

.35 

Table  2.6.  RMS  erron  of  residuals  of  plafe  coordinates  after  each  20  iterations 

of  solution  of  normal  equations  generated  by  simulated  25-photo  strips. 


are  generally  suppressed  to  less  than  3,  5  and  2  ft.  respectively,  for  the  'minimal 
control  case*  and  to  less  than  2,  4  and  1  ft.  for  the  'augmented  control  case  . 

To  place  these  in  proper  perspective  one  should  recall  that  the  assumed  flying 
height  for  these  simulations  is  40,000  ft.  and  that  the  strip  is  on  the  order  of  60 
miles  in  length.  Relative  to  the  measuring  errors  normally  to  be  expected  for  such 
an  operation,  the  errors  in  the  truncation  of  the  iterative  process  at  300  iterations 
are  acceptably  small. 

In  Figs.  2. 10a  through  2. 12b  we  have  plotted  the  errors  of  truncation  of 
the  X,Y,Z  coordinates  along  each  of  the  three  rows  of  control  points.  Not  sur¬ 
prisingly,  these  curves  are  rather  well  correlated  with  the  X^,  Y^,  curves  of 
the  exposure  stations  (Figs.  2.9a  and  b).  Their  amplitudes  are  generally  under  3 
feet  at  300  iterations,  although  the  error  in  the  Y  coordinate  does  become  as  large 
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SWING  (k)  error  (ARC  SEC)  TILT  <j)  ERROR  (ARC  SEC)  TIP  (<l>)  ERRO,  ^  SEC) 


After  100  Iterations 


Figure  2.8q.  Errors  remaining  ir  0,  u,  k  fur  /5-photo  strip  after  truncation  of  iterative 
solution  at  100,  200  and  30C  c.erationt;  minimal  control  cote. 
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SWVNG  {k  )  ERROR  (ARC  SEC)  TILT  ( 


ERROR  (FEET)  Y''  ERROR  (FEET)  ERROR  (FEET) 


10 


After  1(X)  Iterations 
After  200  Iterations 
After  300  Iterations 


Figure  2.9a.  Errors  remaining  in  for  25-photo  strip  after  truncation  of 

iterative  solution  at  100,  200  and  300  iterations;  minimal  control  case. 
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PHOTOGRAPH  NUMBER 
c  c  c 

Figure  2.9b.  Errors  remaining  In  X  ,  Y  ,  Z  for  25-phofo  strip  after  truncation  of 
iterative  solution  at  ICX),  200  and  3(X)  iterations;  aucimented  control 
case. 
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ERROR  (FEET)  Y  ERROR  (FEET) 


Figur*  2.  )0b.  Errors  rtmoining  in  X/Y/Z  of  Itf  row  of  control  of  25-photo  strip  oftor 

truncation  of  itsrotiv*  solution  at  1(X},  200  and  300  itorotions;  ougmtnttd 
control  cost. 
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ERROR  (FEET)  Y  ERROR  (FEET)  X  ERROR  (FEET) 


After  100  Iterations 
After  200  Iterations 
After  300  Iterations 


^5-  , 

-i 


CONTROL  POINT  NUMBER 


Figure  2. Hb.  Error*  remoining  in  X/Y,Z  of  2n<j  row  of  control  of  25-photo  strip  ofter 

truncotion  of  iterotiv?  solution  at  100,  200  and  300  iterations;  augmented 
control  cose. 
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ERROR  (FEET) 


CONTROL  POINT  NUMBER 


Figure  2.12a.  Errori  remaining  in  X,Y,Z  of  3rd  row  of  control  of  25-photo  strip  after 
truncation  of  iterative  solution  at  1(X),  200  and  300  iterations;  minimal 
control  cate. 
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After  100  Iterations 
After  200  Iterations 
After  300  Iterations 


OS  5  feet  at  one  point  (too  great  extent,  this  it  a  reflection  of  the  truncation 
error  in  Y^).  By  normal  standards,  the  truncation  errors  at  300  iterationt  ore 
occeptcbiy  small  for  the  most  port.  However,  further  iteration  to  suppress  the 
maximum  error  In  the  Y  coordinates  to  ci  lower  level  might  be  considered  advisable. 

A  remorkable  property  of  the  error  curvet  of  truncation  Is  that  their  general 
characteristics  closely  resemble  .'hose  of  error  curves  of  meosurement.  If,  for 
example,  one  were  to  add  random  errors  to  the  plate  coordinates  and  Iterate  the 
solution  to  perfect  convergence,  the  resulting  error  curves  would  bear  a  marked 
similarity  in  the  domains  of  spatial  frequency  and  autocorrelation  to  those  curves 
characteristic  of  truncation  of  the  iterative  process.  We  believe  that  a  full  scale 
Investigotion  of  the  autocorrelation  and  crosscorrelation  spectra  of  error  curves  of 
truncation  and  error  curves  of  measuring  would  prove  most  enlightening  and  would 
recommend  this  to  future  studies. 

From  the  error  curves  of  Figs.  2.8a  through  2.12b  It  Is  evident  why  the 
error  remaining  in  the  ground  control  points  (typically  1  to  3  feet  and  as  much  as 
5  feet)  is  seemingly  inconsistent  with  the  very  low  mean  error  of  the  plate  residuals 
(less  than  0.4  microns)  attained  ct  300  Iterations.  Truncation  errors  in  the 
elements  of  orientation  of  successive  photos  are  seen  to  be  highly  correlated. 

This  leads  to  a  gradual  and  subtle  deformation  of  the  model  wherein  the  property 
of  intersection  of  free  rays  is  preserved  ro  a  remarkably  high  degree.  Because 
of  this  pronounced  serial  correlation  of  errors  in  orientation,  systematic  ex¬ 
cursions  of  the  model  are  very  poorly  reflected  by  residuals  in  the  plate 
coordinates.  For  this  reason,  adequate  convergence  is  not  actuolly  attained 
with  simulctad  data  free  of  rondom  plate  measuring  errors  until  the  rms  error 
of  the  plate  coordinates  has  been  suppressed  to  appreciably  less  than  one  micron. 

Simulations  of  the  25-photo  strips  provided  the  first  really  convincing 
evidence  of  the  feasibility  of  the  iterative  approach.  The  computing  time  re¬ 
quired  for  300  iterations  on  the  IBM  7094  was  approximately  7  minutes,  a  value 
competitive  with  the  direct  reduction  of  a  25-photo  strip. 
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2. 1 2  SIMULATION  OF  41  -PHOTO  STRIPS 


Having  definitely  established  the  promise  of  the  iterative  approach  through 
25-photo  simulations/  we  proceeded  to  implement  the  final  stage  of  our  program 
of  simulation  on  strips,  nomely,  the  adjustment  of  the  longest  strip  which  could  be 
handled  totally  in  the  memory  of  a  32K  IBM  7094.  This  was  originally  computed  to  be 
48-photo  strip  for  the  particular  computer  we  were  using.  However,  we  were  forced 
to  cut  this  back  to  41  photos  after  an  expansion  of  the  monitor  of  the  computer  con¬ 
sumed  almost  3000  previously  available  cells. 

In  order  to  gain  a  more  definitive  evaluation  of  th*  'pinch'  effect  of 
absolute  control,  we  considered  five  different  levels  of  control  throughout  the 
41 -photo  strip.  These  are  pictured  in  Fig.  2.13.  in  Case  1  (Fig.  2.13a.)  five 
absolute  points  were  established  at  the  beginning  of  the  strip.  The  four  points 
controlled  only  in  Z  do  not  lie  in  overlap  areas  and  hence  are  actually  dummy 
control  points  introduced  solely  to  preserve  the  convenient  nine  point  pattern, 
in  2  (Fig.  2.13b.)  five  additional  control  points  were  established  at  erd  of 
the  strip.  Coses  3,  4and5(Fi^.  2.13c.,  d.,  e.)  correspond  to  the  introduction 
of  additional  control  at  approximately  the  half,  quarter  and  one-eighth  divisions 
of  the  strip. 

For  each  of  the  five  cases  the  rms  errors  of  the  residuals  of  the  plote 
coordinates  are  listed  in  Table  2.7  for  every  10  iterations  to  50  iterations  and 
for  every  50  iterations  thereafter  to  600  iterations.  The  computing  time,  required 
for  600  iterations  averaged  about  24  minutes.  In  general,  the  computing  time  for 
p  iterations  of  an  n  pho^o  strip  hoving  the  basic  nine  point  pattern  of  control  is 
given  very  nearly  by 

T  (min.)  «  knp 


where 


k  =  a  constant  depending  on  speed  of  the  computer. 


i 

Number  of 
Iterations 

RMS  ERROR  (MICRONS) 

Case  1 

Cose  2 

Case  3 

Case  4 

Case  5 

0 

336.0 

336.0 

336.0 

336.0 

336.0 

1C 

8.2 

7.9 

8.0 

8.3 

8.6 

20 

5.1 

4.9 

5.0 

5.1 

5.2 

30 

4.0 

3.9 

3.9 

3.9 

3.8 

40 

3.4 

3.3 

3.3 

3.2 

2.9 

50 

3.0 

2.9 

2.8 

2.7 

2.3 

100 

2.0 

1.8 

1.9 

1.7 

1.01 

150 

1.5 

1.4 

1.5 

1.4 

.63 

200 

1.3 

1.2 

1.3 

1.13 

.49 

1.15 

1.1 

1.2 

1.01 

.44 

1.00 

1.05 

1.10 

.92 

.43 

350 

.96 

.97 

1.00 

.81 

.42 

400 

.91 

.90 

.96 

.72 

.413 

450 

.85 

.36 

.90 

.67 

.410 

500 

.81 

.83 

.84 

.62 

.407 

550 

.79 

.85 

.80 

.59 

.405 

600 

.75 

.82 

.75 

.56 

.403 

Table  2,7.  RMS  errors  of  residuals  of  plofe  coordinates  after  various  numbers  of 
iterations  of  solution  of  normal  equations  generated  b/  simulated 
41 -photo  strips. 


From  Table  2.7  we  see  that  the  improvement  in  convergence  with  in¬ 
creasing  control  is  not  very  pronounced  until  Case  5  is  reached.  Here,  the  inclusion 
of  but  four  additional  points  (one  new  point  per  10  photos)  leads  to  a  marked  and 
sudden  improvement  in  convergence.  This  is  perhaps  most  strikingly  illustrated  in 
Figures  2. 14  through  2.18  in  which  the  individual  errors  in  the  elements  of  orienta¬ 
tion  and  coordinates  of  control  are  plotted  after  600  iterations  for  Cases  1  '  4  and 
after  200  iterations  for  Cose  5.  The  errors  in  the  X,Y  coordinates  of  control  arc  for 
the  most  part  suppressed  to  less  than  one  foot  in  Cose  5  and  those  for  the  Z  coordi¬ 
nate  are  generally  suppressed  to  less  thun  3  feet.  The  results  for  Case  5  after  200 
iterations  are  actually  superior  to  the  results  for  Case  4  after  600  iterations.  It 
should  be  pointed  out  that  because  of  a  quirk  in  the  program  not  discovered  until 
very  recently,  the  full  value  of  the  acceleration  parameter  for  Block  Successive 
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Figure  2. 13b.  Cae  2 
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Figure  2. t3c.  Cae  3 
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Figure  2. 13<1.  Com  4 
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Figure  2.13  e.  Cae  5 


Figure  2.13.  Iliuitroting  different  leveli  of  control  coniidered  in  timulotioni  of  4i-pboto  itrip. 
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Over-Relaxation  was  not  actually  realized  in  the  simulations  of  the  41 -photo  strip 
(the  results  for  the  25-photo  strip,  on  the  other  hand,  were  not  affected  by  this 
difficulty  which  has  now  been  corrected).  For  this  reoson,  the  results  in  Table  2.7 
and  Figs.  2.14  through  2.18  may  be  regarded  os  a  cony.rvative  indication  of  the 
power  of  the  iterative  method. 

Figs.  2.14  through  2.18  fully  confirm  the  existence  of  the  pinch  effect  of 
absolute  control  first  suggested  by  the  results  of  the  25-photo  simulations.  They 
also  provide  some  insight  into  the  possible  reason  for  the  sudden  improvement  in 
convergence  which  is  realized  once  a  certain  level  of  control  is  established.  All 
simulations  performed  so  far  suggest  that  error  in  truncation  of  the  iterative  process 
for  the  minimally  controlled  strip  has  a  natural  fundamental  spatial  frequency  of 
about  one  cycle  per  12  photos.  Therefore,  the  pinch  effect  exerted  by  control 
introduced  at  any  multiple  of  the  half  cycle  (6  photos)  he*  o  tendency  to  be  in  phase 
with  this  fundamental  spatial  frequency  and  hence  does  not  exert  nearly  as  strong 
an  influence  on  convergence  as  control  deliberately  distributed  to  be  out  of  phase 
with  the  fundamental  frequency.  By  this  reasoning,  control  introduced  at  the  quarter 
cycle  mark  (i.e.,  centered  on  every  third  photo)  should  be  especially  effective  in 
accelerating  convergence.  Fresh  control  introduced  at  the  center  of  every  fourth  to 
fifth  photo  would  'ikewise  significantly  disturb  the  natural  frequency  of  the  system 
and  should  therefore  also  exert  o  marked  influence  on  rate  of  convergence.  Clearly 
the  topic  of  optimal  distribution  of  limited  absolute  control  is  one  warranting  further 
investigation  in  future  studies.  Here,  a  power  spectrum  and  autocorrelation  analysis 
of  the  truncation  error  of  the  iterative  process  os  applied  to  extremely  long  strips 
(at  least  150  photos)  would  be  of  particular  value. 

Perhaps  the  most  important  single  finding  of  the  41 -photo  simulation 
is  that  once  a  certain  minimal  level  of  well -distributed  control  is  attained  the 
convergence  of  the  iterative  process  is  greatly  improved.  This  minimal  level  would 
appear  to  entail  the  introduction  of  fresh  control  on  at  least  every  fifth  photo. 
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2. 13  SIMULATION  OF  3x5  BLOCKS 


B«cauM  of  the  sucewt  of  the  iterative  approach  in  applications  to  photo- 
grammetric  strips,  we  proceeded  to  implement  the  approach  for  photogrommetric 
blodcs.  This  necessitated  the  development  of  o  more  complex  collapsing  algorithm 
and  development  of  a  more  comprehensive  computer  program.  The  resulting  IBM 
7094  progrom  was  tested  on  the  pair  of  simulated  3x5  blocks  pictured  in  Figs.  2.19a 
artd  2.19b.  The  block  with  the  greater  level  of  absolute  control  (Fig.  2.19a) 
wos  reduced  first.  The  cutoff  level  for  iterations  was  set  at  200  iterations  or  on 
rms  error  of  0.5  microns,  whichever  come  first.  The  rms  error  was  set  to  be  com¬ 
peted  every  50  iterations.  As  it  turned  out  the  solution  converged  to  0. 16 
microns  by  the  end  of  the  first  50  iterations.  Hence  no  intermediate  readout  was 
obtained  for  this  case.  The  errors  in  the  X  and  Y  coordinates  of  the  cont'ol  points 
were  suppressed  to  less  than  0.2  ft.  at  50  iterations.  The  errors  in  the  Z  coordinates, 
on  the  other  hand,  were,  in  some  instances,  appreciably  larger,  growing  to  os 
much  os  one  foot.  The  time  required  for  the  solution  (50  iterations)  was  under  one 
minute. 


Because  the  extroordinorily  ro.sid  ror^  of  convergence  experienced  with 
the  initial  3x5  block  hod  not  been  anticipated,  details  on  the  nature  of  the  con¬ 
vergence  were  not  obtained.  To  remedy  this,  the  second  block  (Fig.  2.19b) 
was  generated  with  o  lesser  number  (four)  absolute  control  points  ond  results  were 
read  out  every  10  iterations  for  a  total  of  120  iterations.  The  rms  errors  of  the 
residuals  of  the  plate  coordinates  listed  in  Table  2.8  would  seem  to  indicate  that 
extremely  rapid  convergence  wos  obtained.  On  the  other  hand,  the  errors  in  the 
elements  of  orientation  (Table  2.9)  and  the  coordinates  of  control  (Table  2.10), 
while  generally  acceptably  small  by  normal  stondords,  ore  quite  large  in  some 
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Illustroting  3x5  block  employed  in  numerical  simulations  Figure  2.!9b.  Illustrating  3x5  black  employed  in  numerical  simulations 

(cose  of  9  absolute  control  points).  (case  of  4  absolute  control  points). 


-5Cl- 


1 

1 

*•  1 

HD  ’ 

— ;; — -P 

1 

^  _ 

^0 

^0® 

1 

>0^  ®cP 

1 

o 

20 

O 

ooO 

H 

So 

0 

<s 

wo 

^ 

A 

39 

1 

o®  «  ® 

v _ _ _ 

^0 

1 

t®  M® 

j 

►  o  • 


[ 


C 


9 

N 


c 

■Si 

«^® 

Qs 

_ 

r 

ZO  w  ^ 

=o 

1 

<►  ooO® 

^  go 

00  0 

> 

^  yo 

N)  O 

U»  ^ 

m 

ao 

> 

o 

34 

O 

LiiJ 

So<^ 

c 

32 

9 

- 

o 

!► 

▼ 

r, 

O 

39 

Wo 

CD  -> 

)>, _ ^ 

o 

36 

A 

37 

• 

48 

• 

iL/ 

t,o 

\ _ 

• 

46 

f  «  ®  ^ 

Number  of 
Iterations 

- — 

RMS  Error 
(Microns) 

0 

155.0 

10 

2.7 

20 

1.1 

30 

.70 

40 

.49 

50 

.37 

60 

.29 

70 

.24 

80 

.20 

90 

.17 

100 

.14 

no 

.13 

120 

.11 

Table  2.8.  Convergence  of  iterotlve  solutiori 
of  3x5  block  with  four  absolute 
control  points. 


Photo 

Number 

A<t) 

(sec) 

Au 

(sec) 

Ak 

(sec) 

AX*^ 

(ff) 

AY*^ 

(ff) 

AZ= 

(f*' 

1 

-  in 

i:’4 

6:4 

.35 

-  .26 

-  .06 

2 

-11.0 

1.6 

4.9 

.39 

-2.40 

-1.81 

3 

23.3 

1.6 

6.0 

.36 

5.65 

-  .02 

4 

-  .9 

.9 

6.0 

.20 

-0.12 

-  .19 

5 

-11.3 

1.1 

5.4 

.28 

-2.55 

2.01 

6 

23.5 

1.1 

5.8 

.29 

5.74 

-  .20 

7 

-  1.0 

•  • 

5.6 

.05 

-  .11 

-  .23 

8 

-11.4 

.1 

5.6 

.04 

-2.55 

-2.05 

9 

23.5 

.2 

5.6 

.07 

5.76 

-  .29 

10 

- 

5.2 

-.14 

-  .13 

-  .21 

11 

-11.0 

5.8 

-.15 

-2.57 

-2.03 

12 

23.5 

5.4 

-.16 

5.76 

-  .24 

13 

-  1.0 

4.8 

-.30 

-  .24 

1  r\ 

•  •  1  V 

14 

-11.3 

6.3 

-.27 

-2.43 

-1.89 

15 

23.2 

5.0 

-.23 

5.63 

-  .12 

Table  2.9.  Errors  in  elements  of  orientation  after  120  iterations  of  solution  of 
normal  equations  of  simulated  3x5  block  having  four  absolute  con¬ 
trol  points. 
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— 

POINT  NO. 

AX  (ft.) 

AY(ft.) 

AZ(ft.) 

1 

-.31 

.10 

.00 

2 

-.11 

-.12 

.00 

Column  1 

3 

.35 

1 

.43 

4 

.96 

.37 

.00 

5 

-.29 

.15 

-3.50 

6 

-.16 

-.06 

.00 

7 

-2.13 

-2.24 

.00 

8 

.12 

.06 

.02 

9 

.00 

.10 

.00 

Column  2 

10 

.13 

.12 

.00 

11 

.00 

.02 

-1  82 

12 

-.10 

.14 

-3.  >40 

.00 

.00 

.00 

14 

.05 

.02 

3.39 

15 

1 

o 

.19 

-.20 

16 

.00 

.11 

-.26 

Column  3 

17 

.05 

.14 

-.30 

18 

.02 

.18 

-2.03 

19 

-.02 

.13 

-3.75 

20 

.00 

.06 

-.30 

21 

.03 

.06 

3.18 

1 

22 

.01 

.23 

-.30 

23 

.00 

.01 

-.04 

Column  4 

24 

.01 

.16 

-.38 

25 

.00 

.02 

-2.12 

26 

.03 

.13 

-3.84 

27 

.00 

.00 

-.38 

28 

.03 

.08 

3.09 

29 

.08 

.17 

-.20 

30 

.03 

.11 

-.26 

Column  5 

31 

-.03 

.15 

-.30 

32 

.02 

.20 

-2.05 

33 

.06 

.14 

-3.79 

34 

.03 

.07 

-.32 

35 

.00 

.08 

3.15 

36 

.13 

.06 

-.03 

37 

.00 

.00 

.00 

Column  6 

38 

-.11 

.14 

-.02 

39 

.00 

.28 

-1.92 

40 

.14 

.16 

-3.74 

41 

.00 

.00 

.00 

( 

42 

-.05 

.09 

3.40 

43 

.28 

.03 

.00 

44 

.07 

-.12 

.00 

Column  7 

45 

-.05 

.14 

.37 

46 

-1.01 

.40 

.00 

47 

.36 

.16 

-3.75 

48 

.06 

-.08 

.00 

49 

2.01 

-2,14 

.00 

Table  2.10.  Errors  in  coordinates  of  control  ooints  after  120  iterations  of  solution  of 
normal  equations  generated  by  simulated  3x5  block. 
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instances  (e.g. ,  a  value  of  almost  minus  four  feet  for  AZ  of  point  26).  Such 
errors  are  seemingly  inconsistent  with  the  extremely  low  rms  error  of  0.1  Ip 
attained  at  120  iterations.  The  explanation,  we  believe,  lies  in  an  inherent 
instability  of  the  system  of  no.  no  I  equations.  To  appreciate  this,  one  should 
contemplate  Fig.  2.19b.  Taken  by  themselves  the  three  horizontal  strips  form¬ 
ing  the  block  are  individually  indeterminate.  The  first  and  third  strips  are  in¬ 
determinate  m  tip  (<t>),  for  the  entire  model  can  rotate  about  the  line  joining 
the  two  obsolute  control  points  in  each  of  these  strips.  The  middle  strip  is, 
of  course,  completely  indeterminate  because  it  contains  no  absolute  control. 

By  virtue  of  relative  control  in  the  side  overlaps,  determinacy  is  achieved  when 
the  three  strips  ore  treated  os  an  integral  block.  However,  there  is  a  basic  weakness 
of  the  linkage  between  5he  first  and  third  strips,  for  closures  of  rays  to  the  points 
in  t'  e  side  overlaps  ore  not  strongly  affected  by  small  biases  in  the  tip  angles  of 
strips  1  and  3.  Indeed,  if  the  control  points  in  the  side  overlaps  were  measured 
only  on  those  pairs  of  photos  having  the  same  Y  coordinates  as  the  control  points 
themselves,  the  block  would  degenerate  to  Indeterminacy,  for  Intersection  of  rays 
in  the  side  overlap  would  then  be  perfectly  preserved  under  any  O  rotation  what¬ 
ever  of  strips  1  oind  3.  The  general  tendency  towards  instability  of  the  particular 
block  under  discussion  would  be  strongly  damped,  we  believe,  if  a  single  point 
in  each  of  the  side  overlaps  was  an  absolute  control  point,  A  particularly  good 
choice  would  be  points  24  and  26  of  Fig.  2. 19b. 

The  order  of  the  normal  equations  generated  by  the  3x5  block  Is  237x237. 

The  form  of  the  normal  equations  employed  in  the  simulation  is  Indicated  In  Fig. 
2.20.  For  whatever  academic  interest  they  may  hold,  we  have  presented  in  Figs. 
2.21  and  2.22  two  intertwined  forms  of  the  normal  equations  for  the  3x5  block. 

These  were  developed  before  the  theoretical  shoitcomings  of  the  concept  of  inter¬ 
twining  had  been  opprecioted. 
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Our  limited  simulations  of  photogrommetric  blocks  indicate  that  the  rote 
of  convergence  of  the  iterative  solution  is  several  times  faster  for  a  compact 
block  than  for  a  strip  of  comporoble  number  of  pfiotos  and  level  of  control. 

Thus  the  iterative  approach  is  even  more  attractive  for  large  blocks  than  for  long 
strips. 


Unfortunately,  time  did  not  permit  a  more  extensive  investigation  of  the 
block  within  the  framework  of  the  present  study.  This  will  be  remedied  in  future 
work.  Our  IBM  7094  routine  for  block  odj^ment  is  designed  to  handle  in  core 
any  block  of  dimensions  of  n  photos  by  p  photos  where  nxp  =  45  for  n,  p  >  2. 

When  buffering  teciniqu^s  are  implemented  as  outlined  in  Subsection  2.15,  it 
will  be  possible  to  adjust  blocks  of  virtually  unlimited  dimensions. 

2. 14  ADJUSTMENT  OF  23-PHCTO  STRIP  OF  ACTUAL  PHOTOGRAPHY 

The  various  routines  developed  during  the  course  of  the  investigation  were 
designed  expressly  for  simulated  data  and  were  intended  primarily  as  tools  for 
analysis  and  studies  of  feasibility  of  iterative  solutions  of  the  normal  equations 
arising  from  the  adjustment  of  large  photogrommetric  nets.  In  order  to  process 
reol  data  a  number  of  auxiliory  routines  bod  to  be  written,  most  notable  of  which 
was  a  routine  for  cantilever  extension  designed  to  obtain  shorp  initial  approximations 
for  elements  of  orientation  and  coordinates  of  control  and  also  to  pre-edit  the 
observational  material.  With  such  aux  liary  routines  and  with  appropriate  modi¬ 
fications  of  the  routines  for  simulation  we  were  able  to  process  real  data  in  a  rather 
awkward  fashion.  As  in  our  simulations,  an  IBM  1620  computer  was  employed  for 
all  preliminary  reductions  of  real  data  including  the  preliminary  cantilever  extension 
and  the  formation  of  fhe  collapsed  system  of  normal  equations.  The  solution  of  the 
normal  equations  wa*.  accomplished  on  an  IBM  7094  computer. 
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The  photography  employed  in  our  study  wos  token  over  the  Annex  to 
the  Phoenix  test  range  and  was  supplied  to  us  by  Army  Map  Service  through 
RADC.  The  photography  was  supplied  as  diapositive  plates  and  was  generally 
of  very  good  quality.  Flying  height  was  nominally  10,000  feet  above  the 
overage  terrain.  The  aerial  camera  employed  a  calibrated  6  inch  Planigon 
lens;  the  photo  format  was  9x9  inches.  A  layout  of  the  strip  and  Its  absolute 
control  is  provided  in  Fig.  2.23.  A  total  of  24  absolute  control  points  in  6 
groups  of  3  were  included  in  the  strip.  Unfortunately,  practically  all  of  this 
control  fell  outside  of  triple  overlap  areas  and  thus  could  not  be  accommodated 
by  our  adaptation  of  the  simulation  routines.  Because  of  this  shortcoming  of  the 
routine,  we  elected  to  adjust  the  strip  with  a  minimal  array  of  four  absolute  control 
points.  These  consisted  of  three  point*  across  the  center  of  Photo  1  (XY-3, 

XY-4,  XY-5  of  Fig.  2.23)  and  a  single  point  near  the  centei  f  riic>ru  ^  (ZB-4 
of  Fig.  2.23).  The  images  of  these  points  were  of  excellent  quality.  (The 
first  three  were  signalized  by  special  ground  targets.)  A  nine  point  pattern  of 
relative  control  was  selected  such  that  each  point  lay  in  a  triple  overlap  area 
(except  at  the  ends  of  the  strip).  The  plates  were  measured  on  our  Monn  422  G 
comporator  which  had  been  calibrated  to  one  micron.  The  plote  readings  were 
referred  to  the  calibrated  principal  point  end  were  corrected  for  distortion.  The 
calibrated  principal  distance  was  altered  by  a  precalculated  amount  in  order  to 
compensate  for  atmospheric  refraction  (compensation  for  refraction  in  this  monner 
is  odmiuible  for  neorly  vertical  photography  over  all  but  very  rugged  terroin). 

The  output  of  0  special,  analytical  least  sc^uares  cantilever  extension 
operating  on  single  pairs  of  photos  at  a  time  served  as  initial  opproximations  for 
the  linearization  of  the  observational  equations  for  the  rigorous,  simultaneous 
odjuitment  of  the  strip.  The  iterative  solution  was  set  to  compute  the  mean 
error  of  the  plate  residuals  every  fifth  iteration  and  to  stop  when  the  difference 
between  successive  mean  errors  was  less  than  0.01  microns  or  v^hen  a  maximum  of 
250  iterations  was  reached.  As  can  be  seen  from  Table  2,11,  the  criterion 
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Number  of 
Iterations 

— 

Mean  Error 
(Microfu) 

Difference 

(Microns) 

0 

21.57 

11.96 

1 

9.61 

.70 

2 

8.91 

.41 

3 

8.50 

.30 

4 

8.20 

.21 

5 

7.99 

.88 

10 

7.11 

.12 

15 

6.99 

.027 

20 

6.963 

.009 

25 

6.954 

Table  2.11.  Successive  mean  errors  of  plate  coordinate  residuals 
from  iterative  solution  of  normal  equations  arising 
from  adjustment  of  23-photo  strip  of  actual  photography. 


for  convergence  was  satisfied  by  only  25  iterations,  a  total  computing  time  of 
less  than  40  seconds  for  the  effective  solution  of  a  system  of  equotions  of  order 
363x363.  We  attribute  this  remarkably  rapid  convergence  to  the  excellent 
approximations  obtained  from  the  preliminary  cantilever  extension. 

The  finol  mean  error  of  6.96p  is  a  substontial  improvement  over  the 
21 .57|j  resulting  from  the  preliminary  cantilever  extension.  The  individual 
residuals  ^or  each  point  on  each  photo  are  provided  in  Table  2.12.  These  ore 
seen  to  be  highly  random  throughout  the  strip.  From  the  standpoint  of  internal 
consistency  the  results  of  the  adjustment  are  most  satisfactory. 

Despite  the  substantial  improvement  in  the  mean  error,  the  adjusted  values 
of  the  relative  control  points  generally  differed  from  the  contilever  approximations 
by  less  than  o  foot  with  only  a  few  differing  by  as  much  as  2.5  feet.  The  largest 
adjustment  to  the  angular  elements  of  orientation  was  40  seconds  of  arc  and  most 
were  well  under  20  seconds  of  v-'c;  the  largest  displacement  in  the  positions  of  the 
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Figure  2.23.  Layout  of  23-photo  $trip  of  octuol  photography  reduced  by  methodi  developed  in  present  study. 


Tobl«  2. 12.  Plot*  coordinoto  rMiduolt  multing  from  odjuitmont  of  23-photo  strip  of  octuoi  photogrophy. 


exposure  stations  wos  nearly  3  feet.  In  view  of  this,  the  contilever  extension 
in  its  own  right  provides  a  quite  satisfactory  result.  We  would  not  expect  such 
good  agreement  to  exist,  however,  if  a  liberol  sprinkling  of  absolute  control  were 
carried  in  the  simultoneous  adjustment  of  the  strip. 

Needless  to  soy,  much  more  extensive  experience  with  real  date  is 
required  before  the  full  potential  of  the  photogrommetric  solution  developed  in 
this  report  con  be  definitively  evaluated.  In  order  to  handle  real  data  in  volume, 
it  will  be  necessary  to  develop  programs  expressly  desigrted  for  large  scale  pro¬ 
duction.  This  is  an  entirely  straightforward  task  and  is  one  fully  justified  by  the 
results  obtained  in  the  present  study. 

2.15  COMPUTER  TECHNIQUES 

The  maximum  coefficient  matrix  generated  during  the  course  of  our 
simulations  is  the  633-order  matrix  associated  with  the  normal  equatiom  for  the 
41-photo  strip.  This  corwtitutes  the  largest  coefficient  motrix  which,  together 
with  the  iterative  program,  can  be  stored  in  the  main  memory  of  the  IBM  7094 
computer.  However,  this  by  rw  means  represents  the  limit  for  the  theoretical  capa¬ 
bility  of  the  SOR  technique,  nor  is  it  a  limit  for  the  order  of  the  normal  equa- 
tioftt  which  can  be  solved  using  somewnot  more  advanced  programming  techniques 
that  ore  currently  available.  In  fact,  on  o  computer  with  a  32K  main  memory 
it  would  be  possible  to  generate  and  solve  systems  of  normal  equations  of  order 
approximately  10,000  with  very  little  loss  of  efficiency.  Since  further  reseorch 
in  this  field  anticipates  the  use  of  the  CDC  1604  computer  at  RADC,  we  will 
limit  our  discussion  of  advanced  techniques  to  software  which  is  currently  avail¬ 
able  for  this  machine. 

The  almost  unlimited  capobility  of  the  iterative  progrom  can  be  realized 
through  the  use  of  the  most  odvanced  version  of  FORTRAN,  FORTRAN-63, 
available  for  the  1604  computer  in  conjunction  with  auxiliary  storage  devices 
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such  oa  high-speed,  high-density  mognetic  topes  or  o  mognetic  disk  or  drum, 
ond  with  the  buffering  focility  thot  the  1604  possesses  for  the  transfer  of  doto 
from  on  ouxiliory  storoge  unit  to  the  moin  memory  of  the  computer. 

Insteod  of  storing  the  entire  coefficient  matrix  of  the  normal  equotions  in 
the  main  memory  of  the  computer,  the  data  would  be  stored  in  binary  form  on  on 
ouxiliory  storage  unit  (storage  of  the  dato  in  binary  form  permits  a  higher  rote  of 
data  transfer  than  if  the  informotion  were  stored  in  the  standard  BCD  form).  The 
Ofsiy  information  which  at  oil  times  remains  ovoiloble  to  the  iterotive  program  in  the 
main  memory  of  the  1604  is  the  constant  vector  b  and  the  iterative  vector 
(os  in  (9)),  To  initiote  the  iterative  process,  the  first  row  of  blocks  of  the  co¬ 
efficient  matrix,  cortsistirtg  of  the  6x6  1^  submatrix  for  the  first  photograph  and 
the  nine  6x3  N  submotrices  associated  with  it,  ore  transferred  into  the  main  memory 
of  the  computer  from  the  auxiliary  storage  unit,  and  then  the  first  block  of  the  new 
iterative  vector  is  computed  in  standard  fashion.  While  this  calculation  is  being 
performed  the  second  row  of  blocks  of  the  coefficient  matrix  is  buffered  into  memory 
by  means  of  the  BUFFER  IN  statement  available  in  rORTRAN-63.  The  advantage 
of  the  BUFFER  IN  statement  as  the  instrument  of  data  transfer  from  auxiliary  storage 
to  main  memory  is  that  as  soo<  as  the  transfer  has  been  initiated,  control  Is  returned 
to  the  iterotive  program.  This  then  permits  the  computotion  of  the  first  block  of  the 
iterative  vector  and  the  transfer  of  the  second  block  row  of  data  from  auxiliary 
storage  to  main  memory  to  occur  simultaneously.  The  second  block  row  of  data 
is  then  used  to  compute  the  second  block  of  the  iterative  vector  while  the  tr.ird 
block  row  of  the  coefficient  matrix  is  being  buffered  into  the  main  memory.  Thus, 
through  successive  applications  of  the  above  procedure  it  is  possible  ta  compute  the 
entire  iterative  v-ctor  even  though  at  any  one  time  only  two  block  rows  of  the  co¬ 
efficient  matrix  are  in  the  main  memory  of  the  computer. 

The  only  possibly  significant  loss  of  time  through  the  implementation  of 
this  procedure  would  occur  if  magnetic  tape  were  used  as  the  means  of  auxiliary 
storage.  In  this  case,  a  delay  would  occur  at  the  end  of  each  Iteratian  to  permit 
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the  tape  containing  the  coefficient  matrix  to  be  rewound.  Of  course,  this  oroblem 
would  not  present  itself  if  a  random  access  device  were  available  for  use  as  auxiliary 
storog*  of  the  coefficient  matrix. 

The  delay  cav»ed  by  the  rr.vind  of  the  data  tope  could  be  elimirsoted  if 
sufficient  tape  drives  were  available  to  permit  the  coefficient  matrix  to  be  stored 
on  two  or  more  magnetic  tapes.  In  this  cose,  at  the  completion  of  one  iteration  on 
alternate  tape  would  be  used  for  the  computation  of  the  succeedir^  iteration  while 
the  original  tape  were  being  rewound.  A  more  sophisticated  procedure  could  be 
put  into  use  should  the  Block  Successive  Symmetric  Over  Relaxation  iterative  technique 
prove  feasible.  As  previously  stated  in  Subsection  2.06,  this  method  alternates  a 
forward  and  a  backward  iteration  which  thus  eliminates  the  tape  rewind  completely 
since  at  the  end  of  each  forward  iterotion  the  coefficient  matrix  must  be  entered 
into  memory  in  a  reverse  order  to  perform  the  bockword  iteration.  In  fact,  should 
the  computer  be  equipped  with  the  CDC  607  tope  drive,  which  has  a  backward  rend 
capability,  all  superfluo<js  motion  of  the  tope  would  be  eliminated,  for  tape  motion 
would  occur  only  during  the  actual  process  of  data  transfer. 

From  the  foregoir>g  it  is  clear  that  through  the  use  of  optimal  buffering 
techniques,  essentially  no  time  need  be  wasted  because  of  limitations  of  core 
memory.  We  believe  that  o  comprehensive  reduction  of  a  general  photogrammetri c 
block  leading  to  normal  equations  involving  as  many  os  10,000  unknowns  could 
readily  be  accommodated  by  a  computer  hoving  an  interrsal  memory  equivalent  to 
32K  werds,  preferobly  of  36  binary  bits  or  greater  (total  word  length  for  the  COC 
1604  is  48  bits). 
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